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FOREWORD 


This  monograph  describes  contemporary  tools,  talent,  issues,  and  techniques  applicable  to  design¬ 
ing  defense  products.  The  objectives  are  to  provide  insight  for  managers  concerned  with  the  design 
function  and  to  provide  designers  with  better  understanding  of  the  scope,  tools,  and  issues  involved. 

First  considered  is  designing  for  the  life  cycle  of  the  product.  This  relates  designing  for  performance 
to  designing  for  quality,  reliability  and  maintainability,  production,  special  systems  requirements 
(e.g.,  system  safety,  human  engineering,  electromagnetic  compatibility,  contamination  and  corro¬ 
sion  control,  survivability /vulnerability,  hardware/software  integration,  operation  and  support)  and 
cost.  These  individual  technical  functional  designs  and  the  interrelationships  of  performance,  fitness 
for  use  over  the  life  of  the  equipment,  scheduled  deliveries  and  budget  constraints  are  discussed. 
Then,  managing  the  design  process  is  discussed  followed  by  the  state-of-the-art  in  design  tools,  talent, 
and  computer  aids  for  the  task.  s__ 

The  material  is  based  on  publications  by  the  author  (and  as  co-author)  in  the  Defense  Systems  Manage¬ 
ment  College  Program  Manager,  and  readings  and  charts  developed  for  the  college's  Program  Manage¬ 
ment  Course  by  the  author  and  faculty  members  of  the  Technical  Management  Department. 
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INTRODUCTION 

Defense  systems  are  developed  and  operated  over 
a  long  life  (20  years  and  more).  They  include  com¬ 
plex  products  supported  by  technical  data, 
facilities,  supplies,  support  equipment,  software, 
and  trained  personnel  (Figure  1).  Definition  of  these 
systems  represents  a  significant  design  challenge  for 
Department  of  Defense  (DOD)  managers.  The 
challenge  is  to  provide  the  right  talent,  tools,  and 
expertise  to  do  the  job  and  then  to  direct  the  defini¬ 
tion  of  the  product  which  represents  the  best  trade¬ 
off  among  the  often  competing  life-cycle  re¬ 
quirements  of  the  product.  Requirements  include 
broad  terms  like  system  effectiveness,  life-cycle  cost 
and  schedule  for  full  system  support  and  more 
definitive  terms  like  reliability,  unit  production  cost 
and  performance. 


Evolution  of  the  design  complexity  required  to  op¬ 
timize  defense  products  has  altered  the  central 
nature  of  the  designer.  Early  in  the  century  as  the 
complexity  of  products  increased  and  the  produc¬ 
tion  function  became  specialized,  increased  detailed 
information  was  required  for  other  specialists  to 
use.  This  often  resulted  in  more  drawings  with 
greater  detail.  Hence,  a  division  of  labor  was 
created  so  that  draftsmen  could  assume  some  of 
the  load.  Thus,  more  time  was  provided  for  the 
designer  to  create  because  the  product  could  be 
delegated  for  detailing. 

Mid-century,  overlapping  the  productivity  im¬ 
provement  (more  creative  effort  per  time  dimen¬ 
sion)  of  designers,  the  complexity  spawned 
technical  productivity  (increased  specialist  output 
per  time  dimension)  through  the  creation  of 
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Figure  2.  The  Name  of  the  Game 
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technical  "cults"  (systems  engineers,  analytical 
groups,  industrial  engineers,  producibility 
engineers,  logisticians)  which  displaced  the  central 
nature  of  the  designer  reducing  the  function  near¬ 
ly  to  coordination  rather  than  creation.  Of  course 
the  reason  was  that  designers  did  not  have  the  re¬ 
quired  broad  background  which  encompassed  all 
the  skills  required  for  system  development.  The 
management  approach  was  establishing  a  design 
department  and  other  "ility"  departments  all  tied 
together  by  a  bureaucratic  arrangement  for  draw¬ 
ing  approval  which  "assured  integration."  Never¬ 
theless,  the  designer  worked  to  incorporate  all  the 
inputs  in  as  near  real-time  as  possible  and 
developed  personal  closeness  and  identity  with  the 
design  as  it  progressed  through  manufacture,  test, 
delivery  and  operation. 

In  the  1980s,  computerized  aids  have  continued  to 
improve  design  process  productivity.  But  an  even 
greater  benefit  is  now  available  if  the  computer  aid 
can  support  an  effective  centralized  and  coor¬ 
dinated  integration  of  DOD  product  definition  re¬ 
quirements  without  losing  the  designer’s  "touch." 


Figure  3.  The  Most  Significant  Acquisition  Elements 
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Life-Cycle  Design 

Designing  in  the  defense  system  arena  is  a  challeng¬ 
ing  occupation  requiring  skill  and  knowledge. 
There  are  literally  thousands  of  specifications  and 
standards  which  capture  many  years  of  lessons- 
leamed  and  which  must  be  considered  and  ap¬ 
propriately  streamlined/tailored  for  the  product  re¬ 
quirement.  When  coupled  with  high  technology 
performance  requirements,  fitness  for  service  use, 
scheduled  deliveries,  and  budget  constraints  the 
design  task  is  awesome. 

In  the  final  analysis,  detail  design  is  a  big  trade¬ 
off  game  with  cost  at  the  center  (Figure  2).  The 
designer  must  face  interrelationships  of  "ilities"  that 
have  reached  26  at  the  Defense  Systems  Manage¬ 
ment  College  (Figure  3).  For  convenience  these  are 
captured  herein  under  the  topics  of  quality, 
reliability  and  maintainability,  production,  special 
systems  requirements  and  cost. 

Then  the  life-cycle  cost  trade-off  process  raises 
questions  like: 

—Does  better  quality  cost  more? 

—Does  better  supportability  cost  more7 
—Does  better  producibility  cost  more? 

—Does  better  reliability  cost  more? 
—Does  better  maintainability  cost  more7 

Moreover,  are  questions  like  these  true  individually 
and/or  collectively? 

Responses  usually  include  statements  like  "it  all 
depends  on  how  well  the  designer  balances  unit 
price  and  life-cycle  cost"  and  "not  necessarily 
depending  on  how  well  the  designer  integrates  the 
"ilities"  (Reference  a).  The  fundamental  point  is  that 
the  terms  producibility,  quality,  reliability,  main¬ 
tainability,  and  supportability  are  not  mutually  ex¬ 
clusive  in  design  terms  and  can  (in  fact,  should) 
reinforce  each  other  in  systems  design.  The  fun¬ 
damentals  of  "designing  for..."  are  addressed 
separately  in  the  following  sections  but  recognize 
that  integration  and  iteration  should  occur  through 
a  schematic  like  Figure  4,  whether  computerized 
or  not.  This  concept  is  explained  in  "The  State  Of 
The  Art  In  DOD  Product  Design,"  the  last  section. 

Designing  for  Performance 

There  art  as  many  "methods"  for  product  design 
as  there  are  products,  and  probably  as  many  as 


there  are  designers.  This  description  is  intended  on¬ 
ly  to  provide  a  framework  for  discussions  of  im¬ 
portant  considerations  in  product  definition. 
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The  designer  starts  with  the  specification  and  pro¬ 
portions  a  solution  (a  first  cut  in  the  designer's 
mind)  best  meeting  the  requirements.  For  large 
products  like  airplanes  and  ships,  the  first  defini¬ 
tion  begins  with  small-scale  layouts  that  lead  to 
roughing  in  state-of-the-art  subsystems,  and  refine¬ 
ment  of  external  configuration  through  model 
testing.  For  some  products,  the  creative  process 
starts  better  with  block  diagrams,  proceeds  to  cir¬ 
cuit  schematics,  and  ends  with  packaging. 

During  the  design  phase  where  there  is  a  relative¬ 
ly  low  percentage  of  life-cycle  cost,  decisions  will 
be  made  that  lock  in  approximately  85  percent  of 
the  life-cycle  cost  (Figure  5).  Even  during  initial 
creative  efforts,  the  mind-set  of  the  designer  will 
have  an  impact  on  the  life-cycle  cost. 

When  the  design  is  fluid,  trade-offs  are  in  progress 
to  optimize  performance,  alternatives  are  in  evalua¬ 
tion,  and  minds  are  (at  least  relatively)  open  to  sug¬ 
gestion,  it  is  the  best  time  to  incorporate  life-cycle 
design  requirements.  When  results  begin  to  show 
a  particular  configuration  meeting  the  performance 
goal,  that  configuration  becomes  difficult  to 
change.  The  design  activity  fears  that  changes  to 
accommodate  the  "ilities"  might  deteriorate  the  per¬ 
formance  which  is  the  first  evidence  of  program 
acceptability.  Performance  preoccupation  is  a 
worse  influence  when  test  results  indicate  a  per¬ 
formance  problem  because  then  resources  and  at¬ 
tention  are  drawn  away  from  life-cycle  design.  This 
is  a  well-known  trap;  product  development  is 
driven  by  performance  requirements,  performance 
is  typically  the  first  parameter  tested  and  perform¬ 
ance  test  results  set  the  tone  for  the  development 
cycle.  Performance  is  important  and  may  be  over¬ 
riding,  but  early  in  the  program,  life-cycle  design 
characteristics  should  be  given  fair  consideration 
in  the  design  balam’ng  .  ct. 

Designing  for  Quality 

The  Department  of  Defense  (DOD)  quality  pro¬ 
gram  is  built  upon  three  mutually  supportive  ob¬ 
jectives;  quality  of  design,  quality  of  conformance, 
and  fitness  for  use.  Supportive  in  this  case  contains 
the  implication  of  integration.  A  point  of  view  nar¬ 
rowly  focusing  on  the  topic  of  this  section  is  that 
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Figure  4.  Computer-Aided  Technical  Management 
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quality  of  conformance  and/or  fitness  for  use  of 
a  product  are  influenced  by  the  quality  of  the 
design. 


In  discussing  quality,  it  is  important  to  distinguish 
between  concepts  of  grade  and  consistency.  Fast 
food  chains  concentrate  on  providing  the  food  to 
you  the  same  way  every  time,  wherever  you  are 
(consistency).  Whether  fast  food  is  the  grade  you 
want  is  another  matter.  Design  for  quality  largely 
relates  to  grade,  but  you  should  recognize  that  con¬ 
sistency  and  successful  real-world  use  are  also 
dependent  upon  design. 

Specifics  for  "designing  in  quality"  are  emerging 
but  not  yet  captured  in  a  single  guide.  The  follow¬ 
ing  narrative  provides  a  contemporary  view  of  the 
subject. 

The  basic  policy  of  DOD  is  to  hold  the  contractor 
responsible  for  quality  of  the  product  through  a 
quality  assurance  program.  Quality  assurance  is 
defined  in  DODD  4155.1  as  "a  planned  and 
systematic  pattern  of  actions  necessary  to  provide 
adequate  confidence  that  material,  data,  supplies, 
and  services  conform  to  established  technical  re¬ 
quirements  and  achieve  satisfactory  performance." 
This  clearly  calls  for  a  plan  and  actions.  Suggested 
fundamentals  relating  to  design  are  shown  in  Figure 
6  (Reference  b). 

The  plan  and  actions  will  be  based  on  the  quality 
requirements.  Specifically,  the  designer  must 
understand  the  characteristics  and/or  conditions 
that  represent  the  greatest  stress  to  the  product 
(Footnote  1).  Given  the  most  stressful  environ¬ 
ments),  the  designer  can  evaluate  intended  usage 
and  then  proportion  the  elements  to  operate  at 
stress  levels  conducive  to  attaining  the  desired 
equipment  life. 


Footnote  1 .  An  example;  define  a  vessel  to  hold 
fluid  at  the  dinner  table— commonly  a  "glass."  It 
has  all  the  properties  you  may  desire:  ease  of  clean¬ 
ing,  holds  the  material  fluid,  and  allows  the  user 
to  see  what's  in  the  container.  However,  Its  in¬ 
tended  use  does  not  represent  its  most  stressful  en¬ 
vironment.  Storage  of  glasses  in  a  stack  and  clean¬ 
ing  of  glasses  in  a  dishwasher  cause  more  stress  than 
its  "operational"  environment  of  table-top  use. 
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Figure  5.  System  life  Cycle 
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Figure  6.  Material  Acquisition  Fundamentals 
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Included  in  the  analytical  effort  are  definition  of 
a  worst  case  and  tolerance  for  the  outcome.  Where 
appropriate,  sneak  circuit  analysis  should  be  con¬ 
ducted  so  that  alternate  paths  of  function  will  not 
permit  an  undesired  product  action.  This  is  general¬ 
ly  conducted  by  a  separate  set  of  "design  eyes"  for 
electronic  circuits.  Other  "ics"  (mechanics, 
pneumatics,  hydraulics)  may  require  "sneak  path" 
analysis. 

In  complex  products  it  is  necessary  to  recognize  the 
potential  for  error,  and  plan  for  an  orderly  test  and 
evaluation  of  the  design  quality.  To  this  end, 
predictions  and  allocations  relating  performance 
parameters  are  required  for  monitoring  the  quali¬ 
ty  of  the  functional  analytical  tasks,  and  to  sup¬ 
ply  basic  data  for  system  analysis  tasks  like  failure 
modes  and  effects.  This  extends  the  analysis  to  the 
consequences  of  unplanned  events  which  may  sub¬ 
ject  the  system  to  a  more  severe  environment  than 
specified  in  the  mission  profile. 

A  test,  analyze,  and  fix  cycle  with  closed-loop  re¬ 
porting  is  required  during  development  to  assure 


that  all  of  the  above  design  for  quality  actions  have 
been  successfully  accomplished;  or,  where  failures 
occur  to  provide  an  orderly  basis  for  corrective 
action. 

The  progress  of  the  design  will  be  monitored 
through  the  series  of  design  management  reviews 
generally  conducted  as  part  of  the  defense  system 
acquisition  review  process.  The  design  for  quality 
actions  described  in  this  sect' on  should  be 
monitored  at  every  review  opportunity.  Specific 
definition  of  the  design  for  quality  plans,  actions 
and  reviews  can  be  required  under  contractual  ap¬ 
plication  of  MIL-Q-9858A. 

In  summary,  there  are  some  specific  program  of¬ 
fice  actions  that  will  ensure  design  for  quality. 
Clearly  define  the  critical  mission  profile  elements, 
the  environment  in  which  the  item  is  to  operate 
and,  where  necessary,  provide  criteria  such  that 
elements  of  the  system  operate  at  a  stress  level 
assuring  the  necessary  operating  life.  Then,  monitor 
the  contractor  action  to  assure  a  rigorous  applica¬ 


tion  of  the  principles  identified  in  Figure  6.  Final¬ 
ly,  a  major  milestone  for  the  product  is  the  mis¬ 
sion  profile  qualification  test  which  should  provide 
confidence  that  the  design  for  quality  effort  has 
been  successful. 

In  this  section,  the  term  reliability  has  not  been  used 
purposely  because  a  separate  "design  for"  has 
developed  for  reliability  and  maintainability,  the 
subject  of  the  next  section.  Since  one  way  of  look¬ 
ing  at  reliability  is  that  it  is  the  time  extension  of 
quality  (Reference  c),  some  of  the  approaches  to 
designing  for  reliability  necessarily  relate  to  design¬ 
ing  for  quality.  This  overlap  will  provide  an  op¬ 
portunity  to  cover  more  detail. 

Designing  for  Reliability  and  Maintainability 
(Reference  d) 

The  references  for  this  section  provide  basic  defini¬ 
tions  and  define  policy  and  programs  for  achiev¬ 
ing  DOD  objectives.  This  section  provides  a  focus 
for  what  the  designer  should  do  to  meet  the  objec- 


Figure  7.  System  Effectiveness 


tives.  First,  there  is  recognition  that  reliability  and 
maintainability  are  related;  e.g.,  how  often  must 
I  fix  it?  Second,  there  is  recognition  that  each  term 
stands  alone;  how  predictable  is  mean  time  between 
failure  and  how  long  does  it  take  to  fix  it?  Programs 
for  the  respective  subjects  are  covered  in  MIL- 
STD-785  and  MIL-STD-470.  But,  the  bottom  line 
is  that  system  effectiveness  and  cost  are  the  drivers 
in  design  decisions.  The  following  discussion  ad¬ 
dresses  reliability  and  maintainability  design  in¬ 
teraction  and  functional  design  details  through  the 
system  approach,  using  system  effectiveness  and 
life-cycle  cost  as  measures  for  definition  and  trade¬ 
off  (Reference  e). 

System  Effectiveness  and  Life-Cycle  Cost 
Considerations 

The  emphasis  on  capability  (performance)  has  often 
overridden  reliability,  maintainability  and  cost  con¬ 
siderations.  This  led  DOD  to  state  that  "Improv¬ 


ed  readiness  and  sustainability  are  primary  objec¬ 
tives  of  the  acquisition  process.  Resources  to 
achieve  readiness  will  receive  the  same  emphasis 
as  those  required  to  achieve  schedule  or  perfor¬ 
mance  objectives"  (Reference  f).  To  meet  this  need, 
the  designer  must  structure  a  balanced  approach 
which  considers  system  effectiveness  ar.d  life-cycle 
cost. 

The  elements  of  system  effectiveness  arrayed  under 
its  factors— availability,  dependability,  and 
capability— are  shown  in  Figure  7.  Definitions  for 
important  terms  are  provided  in  Appendix  A  as 
background  for  the  following  discussion. 

Figure  8  presents  an  overview  of  a  methodology 
to  balance  cost  considerations  during  reliability  and 
maintainability  design  balancing  activities.  The 
figure  shows  the  life-cycle  cost  model  as  the  vehi¬ 
cle  by  which  estimates  for  operation,  performance, 
R,  M,  and  cost  are  traded  off  to  obtain  "design  to" 


Figure  8.  R&M  And  Cost  Methods 


target  goals  which  collectively  represent  a  balanced  example,  the  relationship  provides  a  dimension  to 
design.  This  life-cycle  model  includes  submodels  evaluate  the  alternatives  of  designing  for  high(er) 
which  are  representative  of  acquisition  cost  and  maintenance.  That  is,  should  the  design  pursue  a 
logistic  support  costs,  subject  to  the  constraints  of  relatively  high  MTBF,  or  design  ease  of 
functional  objectives  and  minimum  performance  maintenance  into  the  equipment  that  would  result 
requirements.  Defining  the  limits  for  trade-off  of  in  a  low  MTTR. 

R  and  M  parameters  is  critical. 

Frequently,  the  most  practical  way  to  achieve  a 
The  concept  of  availability  is  useful  for  R  and  M  high  probability  of  adequate  system  effectiveness 
trade-off  studies.  Consider  that  over  long  operating  is  to  enhance  the  design  for  reliability  with  a  design 
periods,  the  availability  of  a  system  with  zero  for  efficient  and  rapid  repair  and  a  high  degree  of 
warning  time  can  be  expressed  as  a  relationship  be-  maintainability.  Quantifying  these  factors  in  terms 
tween  uptime  (reliability)  and  downtime  (main-  Qf  availability  provides  an  insight  into  the  effec- 
tainability) .  Details  and  rationale  for  this  approach  tiveness  of  trade-offs  and  demonstrates  numerically 
are  presented  in  Appendix  B.  the  impact  of  variations.  This  approach  also  in- 

Thus,  an  availability  assessment  can  provide  a  creases  design  linkage  with  effectiveness  of  the  R 
measure  of  total  equipment  performance  and  is  and  M  design  and  the  complementing  logistic  sup- 
very  useful  when  performing  R  and  M  trades.  For  port  factors. 


Figure  9.  Cost  versus  Reliability 


Cost  must  also  be  considered  in  this  trade-off  proc¬ 
ess.  For  this  purpose,  additional  relationships  are 
developed  which  define  how  cost  changes  as 
reliability  or  maintainability  are  varied  from  a 
baseline.  For  example,  as  a  system  is  made  more 
reliable  the  operation  cost  should  decrease  since 
there  are  fewer  failures  to  fix.  At  the  same  time, 
it  is  anticipated  that  acquisition  cost  (both  develop¬ 
ment  and  production)  will  increase  to  attain  higher 
reliability  in  the  system.  At  some  point  each  ac¬ 
quisition  dollar  spent  on  increasing  reliability  will 
result  in  one  dollar  saved  in  operating  cost.  This 
point  represents  the  reliability  for  which  total  costs 
are  minimum  (Figure  9). 

Caution:  There  is  a  respected  body  of  opinion  in 
support  of  the  principles  defined  in  Figure  6  and 
expanded  in  Reference  b  which  states  that  this 
general  cost  approach  "casts  reliability  in  the  role 
of  a  cost  driver  and  nothing  could  be  further  from 
the  truth.  I've  worked  in  it  too  long  only  we  didn't 
call  It  reliability;  we  called  it  engineering.  We  didn't 
call  it  any  of  the  acronyms  that  we  now  call  it  and 
we  designed  for  what  we  call  operating  life."  Figure 
9  is  provided  herein  to  show  a  general  thought 
process  about  cost  which  can  link  reliability  and 
maintainability.  The  reader  should  recognize  that 
there  is  a  strong  linkage  between  quality  improve¬ 
ment  and  productivity;  that  is,  a  potential  for 
reduced  acquisition  cost  as  quality  improves.  The 
engineering  principles  of  detail  design  for  quality 
introduced  in  Figure  6  will  be  restated  and  applied 
to  design  for  reliability  in  this  section. 

Although  data  are  limited  early  in  the  program, 
cost  goals  and  minimum  acceptable  performance 
should  be  established  early  (in  the  conceptual 
phase).  The  primary  purpose  of  these  estimates  is 
to  provide  management  with  initial  visibility  so  that 
the  design  configuration  can  be  adjusted  to  pro¬ 
vide  the  cost-effective  minimum  within  the  con¬ 
straints  imposed  and  considering  engineering 
balance.  Then,  trade-offs  will  be  made  over  the  life 
of  the  system.  During  early  program  phases, 
historical  parametric  data  will  be  used  to  propor¬ 
tion  the  system.  Refined  analysis  and  early  tests 
should  be  used  to  verify  operating  and  support 
costs  as  well  as  the  associated  research  and  develop¬ 
ment  costs  (this  generally  will  verify  that  the  signifi¬ 
cant  cost-drivers  in  operation  and  support  are 
reliability,  modularity,  fault  isolation,  sparing,  and 
manning). 


Data  banks  must  be  updated  to  provide  the  most 
accurate  parametric  estimating  data  for  items  such 
as  scheduled  and  unscheduled  maintenance 
manhours,  adequacy  and  utility  of  support  equip¬ 
ment  and  technical  manuals,  diagnostic  testing,  and 
training.  During  early  development,  many  alter¬ 
nates  are  still  under  consideration  and  many  data 
items  remain  rough  estimates.  But  when  a  pro¬ 
totype  design  appears,  more  accurate  logistic  and 
support  costs  can  be  estimated.  Then,  trade-offs 
can  be  made  with  increased  confidence  in  the 
following  areas: 

*  Improved/increased  test  equipment  to  reduce 
maintenance  manhours  and/or  schedule  span 
time 

*  Reliability  improvement  (and/ or  growth)  to 
reduce  spares  and  repair  actions 

*  Maintenance  facilities  and  manhours  to 
reduce  logistics  delay  time 

*  Spare  inventory  to  reduce  logistic  delay  time. 

Then,  cost  targeting  can  be  expanded  to  include 
requirements  on  the  number  of  operating  and 
maintenance  personnel  permitted,  support  equip¬ 
ment  costs,  the  number  of  line  items  permitted  in 
inventory,  and  the  impact  of  fault  detection  and 
isolation.  Throughout  the  cost  analysis,  the  follow¬ 
ing  questions  should  be  addressed: 

(1)  Does  the  latest  design  iteration  meet  the  ef¬ 
fectiveness  and  cost  goals? 

(2)  Do  alternative  designs  exist  which  can  further 
minimize  cost  of  ownership  and  enhance  system 
effectiveness? 

Once  a  design  proceeds  to  detailing,  trade-off 
analysis  can  follow  in  more  detail.  Now,  the  im¬ 
pact  of  changes  in  parameters  like  part  quality, 
redundancy,  component  reliability,  and  pro- 
ducibility  methods  can  be  analyzed.  Then,  it 
becomes  possible  to  identify  high-cost  areas  and 
develop  alternatives  to  reduce  the  cost  while  the 
design  is  in  a  relative  fluid  state. 

Establishing 

Reliability  and  Maintainability 
Requirements 

Reliability  and  maintainability  begin  with  realistic 
and  achieveable  requirements  established  jointly  by 
the  military  user  and  the  developer  in  the  follow¬ 
ing  manner: 
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*  Evaluate  the  reliability  and  maintainability 
of  (similar)  systems  in  the  field  to  estab¬ 
lish  current  levels  and  improvement 
trends  (see  Figure  10) 

Conduct  system  trade-off  analysis  involving 
R  and  M  levels,  effectiveness,  and  logistic 
functions  to  establish  tentatively  the 
needed  and  affordable  R  and  M  level 

*  Assess  the  tentative  requirements  for 
feasibility  of  attaining  the  desired  R  and 
M  goals,  of  the  schedule  in  striving  for 
the  goals,  and  of  related  functional  impli¬ 
cations  such  as  the  ability  to  determine 
by  test  that  the  equipment  has  met  the  R 
and  M  goals 


*  Establish  specified  values  for  R  and  M. 
These  likely  will  be  single-point  values  to 
be  used  in  design  of  the  system,  but  cer¬ 
tainly  will  have  some  tolerance  related  to 
the  maturity  of  the  system  design  and  the 
supporting  data  base.  The  analysis  of 
these  design  points  should  provide  insight 
for  determining  if  incentives  to  do  better 
may  pay  off  in  lower  life-cycle  cost, 
and/or  if  there  is,  or  should  be,  a  toler¬ 
ance  for  doing  less  well. 

To  reiterate  the  engineering  principles  defined  in 
Figure  6,  the  most  difficult  but  required  input  for 
determining  R  and  M  parameters  is  defining  the 
mission  profile  and  the  environment.  What  is  the 
system  to  do,  in  what  environment,  for  how  long? 


Figure  10.  Radar  System  Hierarchy  (partial  listing) 


R  and  M  Activities 

The  development  of  an  R  and  M  program  requires: 
understanding  the  system  requirements  (Figure  11), 
allocation  of  R  and  M  to  each  system  element 
(Figure  12),  developing  a  design  philosophy  em¬ 
phasizing  R  and  M  program  elements  (Figures  13 
and  14),  developing  test  criteria  that  verifies  the 
design  and  provides  for  growth  (Figure  15)  and, 
finally,  planning  for  the  process  to  sustain  designed 
(inherent)  R  and  M  values  (MTBF,  MTTR)  during 
production  and  deployment. 

A  conservative  philosophy  stressing  the  use  of  pro¬ 
ven  hardware,  simplicity,  and  R  and  M  re¬ 
quirements  suited  the  operational  needs  will  reduce 
risk,  improve  R  and  M,  and  lower  operational  and 
support  costs;  but,  it  may  not  permit  stretching  the 
state  of  the  art,  thus  achieving  the  desired  effec¬ 


tiveness.  Whether  the  conservative  approach  will 
meet  the  goals,  or  whether  it  is  necessary  to  push 
the  state  of  the  art,  if  cost  is  to  be  attained  effec¬ 
tively,  R  and  M  requirements  must  be  streamlined 
to  meet  the  program  needs. 

Regardless  of  philosophy,  having  selected  a  source 
capable  of  the  desired  emphasis  on  design  for 
reliability  and  maintainability,  the  following  is  ap¬ 
plicable  to  all  programs: 

*  Contract  for  reliability  and  maintainability 

*  Design  to  minimize  failures  and  improve 
readiness 

*  Test  to  verify  the  design 

*  Sustain  reliability  and  maintainability  in  pro¬ 
duction  and  service. 


Figure  11.  Understanding  System  Requirements 
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Figure  12.  Reliability  Block  Diagram 


Contract  for  Reliability  and  Maintainability 

After  R  and  M  requirements  have  been  estab¬ 
lished  and  allocated  to  subsystems  and  elements, 
the  apportioned  values  (MTBF,  MTTR)  should 
be  included  in  appropriate  sections  of  procure¬ 
ment  specifications,  critical  item  specifications, 
and  contractor  end-items  specifications. 

The  designer  must  understand  every  requirement 
the  system  must  meet  and  understand  where  and 
if  trade-offs  are  desired /permitted.  In  some 
cases,  then,  the  contract/specification  will  in¬ 
clude  required  value(s)  and  one  or  more  alter¬ 
native's) .  Alternatives  may  be  attractive  because 
they  offer  reduced  cost,  or  because  they  repre¬ 
sent  an  attractive  trade  of  resources.  In  the  lat¬ 
ter  case,  the  contract  must  define  the  basis  for 
pursuing  alternatives  and  any  incentives  for  ac¬ 
complishing  improved  cost  and/or  system 
effectiveness. 

Design  to  Minimize  Failures 

Techniques  for  designing  to  minimize  failures  in 
DOD  products  were  introduced  in  designing  for 
quality  (Figure  6)  and  are  expanded  here 
(Reference  e): 

*  Mission  Environmental/Life  Profile 

*  Derating  Criteria 

*  Stress  Analysis 

*  Worst-Case  Analysis 

*  Failure  Modes  and  Effects 

*  Sneak  Circuit  Analysis 

*  Prediction  and  Allocation 

*  Part  and  Material  Selection 

*  Simplification 

*  Redundancy 

*  Ease  of  Inspection  and  Maintenance 

*  Modularity 

*  Built-In  Test/Built-in  Test  Equipment 

*  Design  Reviews 

Mission/Environmental/Life  Profile 

The  most  critical  information  the  program  office 
must  supply  to  the  designer  is  in  what  environment 
and  for  how  long  a  product  must  achieve  the  re¬ 
quired  effectiveness.  Figures  16  and  17  list  en¬ 


vironmental  factors  which  must  be  considered  for 
DOD  equipment.  The  figures  also  provide  brief 
descriptions  of  techniques  for  addressing  en¬ 
vironmental  requirements. 

Stress  Analysis 

"If  you're  under  stress  you're  not  reliable,  if  I'm 
under  stress  I'm  not  reliable  (Reference  b)."  Stress 
analysis  is  fundamental  to  designing  for  reliabili¬ 
ty  and  there  are  many  texts  covering  general  and 
specific  techniques  for  analyzing  stress.  The 
discipline  is  increasing  productivity  and  ability  to 
handle  complex  problems  in  near  real-time  through 
application  of  computer  aids.  Under  the  umbrella 
of  computer-aided  engineering  (CAE),  there  is 
linkage  with  dynamic  simulations  and  active  testing 
of  hardware  to  establish  actual  operational  stresses 
more  accurately  and  quickly. 


Figure  13.  Reliability  Program  Elements  By  Program  Phase 
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Figure  14.  Maintainability  Program  Elements  By  Program  Phase 
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Figure  15.  R&M  Maturation  Achieved  Through  Dedicated  Test  Analysis  and  Fix  Programs 


Figure  16.  Environmental  Stresses,  Effects  and  Reliability  Improvement 
Techniques  in  Electronic  Equipment 


Environmental 

Strait 

Effects 

Reliability 

Improvement  Techniques 

High  Temperature 

Parameters  of  resistance,  Inductance,  capacitance,  power  factor, 
dielectric  constant,  etc.,  will  vary;  insulation  may  soften;  moving 
parts  may  jam  dua  to  expansion;  finishes  may  blister;  devices 
suffer  thermal  aging;  oxidation  and  other  chemical  reactions  are 
enhanced;  viscosity  reduction  and  evaporation  of  lubricants  are 
problems;  structural  overloads  may  occur  due  to  physical 
expansions. 

Heat  Dissipation  devices, 
cooling  systems,  thermal 
insulation,  heat-withstanding 
insulation,  heat-withstanding 
materials. 

Plastics  and  rubber  lose  flexibility  and  become  brittle;  electrical 
constants  vary;  ice  formation  occurs  when  moisture  is  present; 
lubricants  gal  and  increasa  viscosity;  high  heat  losses;  finishes 
may  crack;  structures  may  be  overloaded  due  to  physical  contraction 

Heating  devices,  thermal 
insulation,  cold-withstanding 
materials. 
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Materials  may  be  instantaneously  overstressed  causing  cracks  and 
mechanical  failure;  electrical  properties  may  be  permanently 
altered.  Crazing,  delamination,  ruptured  seals. 

Combination  of  techniques 
for  high  and  low 
temperatures. 

Shock 

Mechanical  structures  may  be  overloaded  causing  weakening  or 
collapse;  items  may  be  ripped  from  their  mounts;  mechanical 
functions  may  be  impaired. 

Strengthened  members,  re¬ 
duced  inertia  and  moments, 
shock  absorbing  mounts. 

Vibration 

Mechanical  strength  may  deteriorate  due  to  fatigue  or  overstress; 
electrical  signals  may  ba  mechanically  and  erroneously  modulated; 
materials  and  structures  may  be  cracked,  displaced,  or  shaken 
loose  from  mounts;  mechanical  functions  may  bo  Impaired;  finishes 
may  be  scoured  by  other  surfaces;  wear  may  be  Increased. 

Stiffening,  control  of 
resonance. 

16 


Figure  17.  Environmental  Stresses,  Effects  and  Reliability  Improvement 
Techniques  in  Electronic  Equipment  (Continued) 


Environmental 

Stmt 

Effects 

Reliability 

Improvement  Techniques 

Humidity 

Ponotratos  porous  substances  and  causes  leakage  paths  between 
electrical  conductors;  causes  oxidation  which  leads  to  corrosion; 
moisture  causes  swelling  In  materials  such  as  gaskets;  excessive 
loss  of  humidity  causes  embrittlement  and  granulation. 

Hermetic  sealing,  moisture- 
resistant  material,  dehumldi- 
flers,  protective  coatings. 

Salt  Mmosphara 
■nd  Spray 

Salt  combined  with  water  is  a  good  conductor  which  can  lower  insula¬ 
tion  resistance;  causes  galvanic  corrosion  of  metals;  chemical 
corrosion  of  metals  is  accelerated. 

Nonmetal  protective  covers, 
reduced  use  of  dissimilar 
metals  In  contact,  hermetic 
sealing,  dehumidifiers. 

Elactremagnatic 

Radiation 

Causes  spurious  and  erroneous  signals  from  electrical  and  electronic 
equipment  and  components;  may  cause  complete  disruption  of  normal 
electrical  and  electronic  equipment  such  as  communication  and 
measuring  systems. 

Shielding ,  matsrlal  selection, 
part  type  selection. 

Nudaar/Cesmic 

Radiation 

Causos  boating  and  thermal  aging;  can  alter  chemical,  physical  and 
electrical  properties  of  matorials;  can  produce  gases  and  secondary 
radiation;  can  cause  oxidation  and  discoloration  of  surfaces;  damages 
electrical  and  electronic  components  especially  semiconductors. 

Shielding,  component  selec¬ 
tion,  nuclear  hardening. 

Sand  and  Dust 

Finely  finished  surfaces  are  scratched  and  abraded;  friction  between 
surfaces  may  be  incroasod;  lubricants  can  be  contaminated;  clogging 
of  orifices,  etc.;  matorials  may  be  worn,  crackod,  or  chipped; 
abrasion,  contaminates  insulations,  corona  paths. 

Air-filtering,  hermetic 
sealing. 

Low  Prossura 
(High  Attitude) 

Structures  such  as  containers,  tanks,  ate.,  are  ovorstrossad  and  can  be 
exploded  or  fractured;  seals  may  (oak;  air  bubbles  In  materials  may 
explode  causing  damage;  internal  heating  may  Increase  duo  to  lack  of 
cooling  medium;  insulations  may  suffer  arcing  and  breakdown;  ozono  may 
be  formed;  outgasing  Is  mors  likely. 

Increased  mechanical 
strength  of  containers,  pres¬ 
surization,  alternate  liquids 
(low  volatility),  improved 
Insulation,  improved  heat 
transfer  methods. 

Derating  Criteria 

The  key  to  reliability  and  long  life  is  to  design  for 
low-stress  levels.  In  electronics  parlance,  the  term 
"derating"  is  used  to  identify  the  technique  for 
designing  to  lower-than-maximum-capability 
parameters  (e.g.,  junction  temperatures,  current 
carrying  capacity).  For  structural  and  mechanical 
components,  the  term  often  used  is  "margin  of  safe¬ 
ty"  (lower  stress  than  maximum  capability).  The 
concept  is  that  "working"  the  components  in  an 
easy  stress  environment  leads  to  high  reliability  and 
long  life. 


In  general,  the  reaction  to  derating  and  safety 
margins  is  that  weight,  volume  and  cost  (and  other 
design  effects  dependent  upon  these  details)  suffer. 
Trade-offs  are  usually  required.  The  designers 
challenge  is  to  minimize  the  impact  by  using  inno¬ 
vative  design  techniques;  e.g.,  handle  heat  by  prop¬ 
er  placement  of  components  or  by  using  natural 
cooling,  provide  margins  of  stress  safety  by  using 
efficient  structures/mechanics  and/or  efficient 
materials. 


Worst-Case  Analysis 

Department  of  Defense  products  generally  are 
characterized  by  complexity,  high  performance, 
and  severe  environment.  Therefore,  it  is  important 
to  sort  out  conditions  resulting  in  the  worst  case 
for  the  design,  and  then  to  assure  that  related 
stresses  (component,  subassembly,  assembly,  sys¬ 
tem)  are  considered  properly  in  assessments  of 
reliability  and  life. 

Failure  Mode,  Effect,  and  Criticality  Analysis 

This  effort  primarily  supports  safety  and  hazard 
analysis,  but  the  benefits  of  looking  at  the  design 
from  this  standpoint  reach  beyond  the  important 
aspect  of  safety.  Figure  18  shows  one  format  used. 
Listed  on  the  figure  are  nine  other  important  utilities 
for  the  process. 

Sneak  Circuit  Analysis 

Reference  (b)  provides  a  good  example  of  a  sneak 
circuit  related  to  an  automobile.  "You  will  notice 
that  if  you  turn  your  radio  on  in  a  . . .  car  the  radio 
won't  play  unless  the  ignition  key  is  turned  on. 
There's  an  interlock  in  there  to  keep  you  from  leav¬ 
ing  your  radio  on  and  wearing  out  the  battery. 
Now,  with  the  radio  switch  on,  leave  the  ignition 
key  off.  Reach  down  and  pull  out  the  flasher,  then 
hit  the  brake  and  the  radio  will  play.  That's  an  ex¬ 
ample  of  a  sneak  circuit." 

The  complexity  of  DOD  products  creates  the 
potential  for  alternate  paths  of  functional  action. 
This  requires  a  separate  application  of  rigor  in  the 
analysis,  a  discipline  to  see  that  sneak  circuit  ef¬ 
fects  do  not  create  unwanted  events.  The  rigor  is 


not  only  applicable  to  electronics;  complexities  in 
other  "ics"  (e.g.,  mechanics,  hydraulics,  fluidics) 
and  structures  require  sneak  "path"  analysis. 

Predictions  and  Allocations 

Fundamental  to  proportioning  the  elements  of  the 
design  is  predicting  the  capability  of  each  element 
and  the  combination(s)  as  a  system.  The  technique 
suggested  here  addresses  reliability  and  main¬ 
tainability  but  is  applicable  to  other  "design  for" 
requirements. 

Use  a  work-breakdown  structure  approach.  Given 
an  allocation  for  the  top-level  assembly  or  system, 
break  down  the  top  level  into  its  components  and 
allocate  proportions  of  the  goal  based  on  predic¬ 
tions  for  the  capability  to  design.  Of  course,  this 
will  lead  to  checking  the  feasibility  of  the  total  goal; 
trade-offs  to  achieve  overall  goals  like  minimum 
life-cycle  cost  in  a  better  way;  and,  establishing 
tolerances  in  the  predictions  with  related  risks  and 
alternatives.  Then,  set  up  a  program  to  check  prog¬ 
ress  against  the  allocations  through  continuing 
analysis,  simulation  and/or  test 

Part  and  Material  Selection 

"Parts  are  the  building  blocks  of  equipment  and 
systems.  The  inherent  or  generic  failure  rates  of 
parts  and  the  design  application  of  parts  will  prin¬ 
cipally  determine  failure  frequency,  readiness,  mis¬ 
sion  success,  maintenance  cost,  and  logistic  sup¬ 
port  cost.  Parts  which  are  similar  functionally  are 
available  with  a  wide  range  of  inherent  failure  rates. 
Depending  upon  the  parts  selected,  a  system  of 
1,000  parts  may  have  a  mean-time-between-failure 
of  100  hours  or  100,000  hours.  Established,  reliable 


Figure  18.  Failure  Mode,  Effect  and  Criticality  Analysis 


Failure  Mods  Analysis 


Failure  Effect  Analysis 
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•  Uncover  parte  and  materials  misapplications 

•  Identify  single-point  failures 

•  Assist  In  dosign-slmpllfication  efforts 

•  Identify  maintonanco-dosign  characteristics 

•  Support  RMA  analyses  predictions,  and  allocations 


•  Assist  the  spares-selection  process 

•  Identity  critical  Items  for  configuration  control/traceability 

•  Establish  quality  inspection  points 

•  Assist  In  test-program  planning 

•  Support  safety  and  hazard  analyses 
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parts  with  the  best  available  failure  rates  cost  more 
to  manufacture  and  test  than  commercial  parts.  So 
the  initial  cost  is  higher  but  the  system  life-cycle 
cost  may  be  significantly  lower  (Reference  h)." 

Early  in  a  program,  parts  specialists  will  establish 
the  program  parts  selection  list  (PPSL)  which 
designers  use  to  select  standard  parts  that  meet  pro¬ 
gram  qualification,  documentation,  and  reliabili¬ 
ty  requirements.  Figure  19  indicates  considerations 
for  part  selection  and  control,  and  Figure  20  in¬ 
dicates  the  breadth  of  the  process  (Reference  e). 


Figure  20.  Parts  and  Materials  Control 


•  Establish  parts  and  materials  R&M  plan 

•  Prepare  parts  specifications 

•  Review  parts  selection  and  application 

•  Conduct  detailed  failed  parts  analyses 

•  Maintain  parts  standardization  program 

•  Publish  preferred  parts  lists 

•  Establish  parts  screening  program 

•  Establish  derating  policies 

•  Conduct  parts  and  materials  research 


Figure  19.  Considerations  for  Part  Selection  and  Control 


a)  Determine  part  type  needed  to  perform  the  required  function  and  the  environment 
in  which  It  Is  expected  to  operate. 

b)  Determine  part  criticality. 

•  Does  part  perform  critical  functions  (l.o.,  safety  or  mission  critical?) 

•  Does  part  hava  limited  life? 

•  Does  part  have  long  procurement  lead  time? 

•Is  the  part  reliability  sensitive? 

•  Is  the  part  a  high-cost  item  or  does  It  require  formal  qualification  testing? 

c)  Determine  part  availability. 

•  Is  part  on  a  Preferred  Part  List? 

•  Is  part  a  Standard  MIL  Item  available  from  a  qualified  vendor? 

•What  Is  normal  delivery  cycle? 

•Will  part  continue  to  be  available  throughout  the  life  of  the  equipment? 

•  Is  there  an  acceptable  in-house  procurement  document  on  the  part? 

•Are  there  multiple  sources  available? 

d)  Estimate  expected  part  stress  in  Its  circuit  application. 

e)  Determine  reliability  level  required  for  the  part,  in  Its  application. 

f)  Determine  the  efficiency  of  burn-in  or  other  screening  methods  in  Improving  the 
part's  failure  rate  (as  required). 

g)  Prepare  an  accurate  and  explicit  part  procurement  specification,  where  neces- 
ary.  Specifications  should  include  specific  screening  provisions,  as  needed  to 
assure  adequate  reliability. 

h)  Determine  actual  stress  level  of  the  part  in  Its  intended  circuit  application.  In¬ 
clude  failure  rate  calculations  per  MIL-HDBK-217B. 

i)  Employ  appnpriate  derating  factors  consistent  with  reliability  prediction  studies. 

j)  Determine  need  for  non-standard  part  and  prepare  a  request  for  approval  as  out- 
lined  in  MIL-SfD-749  or  MIL-STD-891. 


Figure  22.  Reliability  and  Redundancy 


Simplification 

Simplicity  impacts  many  of  the  "designing  for  ‘ili- 
ty'"  topics.  Fewer  parts  means  less  to  build,  less 
to  fail,  less  to  maintain,  and  less  to  spare.  An  ex¬ 
ample  of  design  for  simplification  is  shown  in  Figure 
21.  Reference  (b)  indicates  that  the  goal  for  the  F404 
engine  used  in  the  F-18  was  to  contain  half  the  part 
count  of  the  J79  engine  (while  achieving  the  re¬ 
quired  performance).  The  figure  (21  here,  from 
Reference  b)  shows  that  the  part  reduction  goal  was 
not  quite  attained  but  a  significant  reduction  was 
achieved  and  reliability  increased. 

Redundancy 

Another  approach  used  in  effective  design  is  redun¬ 
dancy,  the  application  of  added  elements  (as  op¬ 
posed  to  simplicity,  fewer  elements)  to  improve 
reliability.  The  mathematical  relationship  for 
reliability  and  redundancy  is  shown  on  Figure  22. 
This  approach  falls  in  two  general  groups  (and 
combinations),  multiple  capable  elements  in  opera¬ 
tion  and  switchover.  In  the  former  case,  a  critical 
function  is  designed  such  that  two  or  more  elements 
operating  in  parallel  can  each  meet  the  performance 
requirements.  Then,  if  one  fails  there  is  one  or  more 
element  in  place  to  accept  "the  load."  Another  ap¬ 
proach  provides  multiple  elements  but  only  single 
operation  until  failure  which  then  triggers  switch¬ 
over  to  another  element. 

In  addition  to  the  two  general  groups  and  related 
techniques  of  redundancy,  another  form  can  exist 
within  normal  (non-redundant)  design  forms. 
Parallel  paths  within  a  network  often  are  capable 
of  carrying  added  load  when  elements  fail.  This  can 
result  in  degraded  but  tolerable  output.  The 
allowable  degradation  depends  upon  the  number 
of  alternate  paths  available.  Where  a  mission  can 
be  accomplished  using  an  equipment  with  degraded 
output,  the  failure  definition  can  be  relaxed  to  ac¬ 
commodate  degradation.  This  approach  has  lead 
to  the  concept  of  "graceful  degradation." 

The  decision  to  use  redundant  design  techniques 
must  be  based  on  careful  analysis.  Redundancy 
may  provide  the  only  choice  when  other  methods 
of  improving  reliability  are  exhausted  and  when 
methods  of  part  improvement  are  more  costly  than 
duplications.  Redundancy  may  offer  an  advantage 
in  preventive  maintenance  considerations.  The  ex¬ 
istence  of  redundant  equipment  may  allow  for 


Figure  23.  Availability  Gain  With  Repair 
Capability  at  Parallel  Redundant  Element 
at  Failure 


repair  with  no  system  down  time  (Figure  23).  Oc¬ 
casionally,  requirements  exist  such  that  equipment 
cannot  be  easily  maintained  (e.g„  spacecraft).  In 
such  cases,  redundancy  is  often  used  to  extend 
operating  time  without  failure. 

Of  course,  the  application  of  redundancy  imposes 
penalties  which  must  be  minimized  through  in¬ 
novative  designs  and  traded  off  versus  increased 
weight,  space,  complexity,  cost,  and  development 
time. 


Figure  24.  Operational  Requirements  and  Equipment  Maintainability  Requirements 


Ease  of  Inspection  and  Maintenance 

Inspection  and  maintenance  in  operation  (Figure 
24)  are  facilitated  by  special  features  of  design 
which  enhance  producibility,  inspectability  and 
testability.  These  features,  covered  from  the  pro¬ 
duction  viewpoint  in  designing  for  producibility, 
aid  the  inspector  or  maintenance  technician  in  con¬ 
ducting  preventive  and  corrective  maintenance 
(Figure  25)  and  in  recognizing  and  diagnosing 
failures  or  weak  areas  and  making  repair  as  early 
and  rapidly  as  possible.  The  viewpoint  of  design 
for  operational  maintenance  ease  is  represented  in 
Figure  26. 

Modularity 

The  extension  of  simplicity  goals  to  maintenance 
is  encouragement  for  breaking  the  system  into  con¬ 


venient  modules  for  handling,  troubleshooting, 
repairing  and  testing,  then  minimizing  the  types  of 
modules.  This  becomes  another  feature  for  trade¬ 
off  in  the  life-cycle  cost  analysis. 

Built-in  Test /Built  in  Test  Equipment 

Miniaturization  and  reliability  improvement  of  cir¬ 
cuitry  that  will  check  integrity  of  operating  systems 
has  made  possible  the  "built-in"  approach  which 
alerts  for  failure,  reduces  repair  response  time,  and 
can  reduce  operating  cost  and  thus  life-cycle  costs. 
However,  the  addition  of  built-in  parts  can  degrade 
reliability  and  maintainability  through  false  alarms 
or  induced  system  failures  and  will  result  in  added 
space,  weight  and  cost  in  the  basic  design.  This  is 
another  example  of  system  trade-off  which  must 
be  made  to  optimize  the  life-cycle  parameters. 
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Figure  25.  Primary  Subsets 
of  Maintenance  Activities 


Figure  26.  Ease  of  Maintenance  Guidelines 


Design  Reviews 

The  management  tool  for  ensuring  proper  con¬ 
sideration  of  reliability  and  maintainability  issues 
is  participation  in  the  design  review  process  as 
described  in  design  management 

Test  to  Verify  the  Design 

Testing  the  reliability  and  maintainability  (R&M) 
picks  up  at  designing  and  producing  initial  prod¬ 
ucts  and  then  operates  in  a  test,  analyze  and  fix 
parallelism  to  achieve  the  program  goals.  Both 
design  qualification  testing  and  R&M  growth 
testing  are  involved.  Design  qualification  testing 
measures  the  capability  of  the  proposed  design  to 
meet  established  R&M  goals.  This  is  accomplished 
by  comparing  the  design  to  a  similar  product  with 
proven  R&M  values.  After  the  basic  design  of  a 
part,  component  or  subsystem  has  been  estab¬ 
lished/qualified,  resources  should  be  allocated  to 
conduct  R&M  growth  testing.  Growth  testing  or 
Test  Analyze  and  Fix  (TAAF)  consists  of  testing 
and  then  analyzing  the  results,  correcting  (fixing) 
the  problem,  and  retesting  (Figure  15).  The  pur¬ 
pose  is  to  identify  design,  parts,  and  quality  prob- 


Fallure  diagnosis,  identification  and  replacement  are  facilitated 
by: 

•  Using  modular  design  techniques 

•  Use  of  special  built-in  circuits  for  fault 
detection,  error  warning  tights,  etc. 

•  Designing  for  replacement  at  higher  levels 

•  Using  increased  skill  level  technicians 

•  Increasing  depth  of  penetration  of  localization  features 

•  Utilizing  test  indications  which  are  less  time 
consuming  and/or  less  difficult  to  interpret 

•  Designing  for  minimum  diagnostic  strategies 

•  Making  accessible  and  obvious  both  the  purpose 
of  the  test  points  and  their  relationship  to  the  item 
tested 

•  Improving  quality  of  technical  manuals  or  maintenance 
aids 

•  Designing  access  for  ease  of  entry 

•  Reducing  number  of  access  barriers 

•  Reducing  need  tor  isolation  access  by  bringing  test 
point,  controls  and  displays  out  to  accessible  locations 

•  Reducing  number  of  interconnections  per  replaceable 
item 

•  Using  plug-in  elements 

•  Reducing  requirements  for  special  tools. 


lems  such  that  when  fixed,  the  product  will 
demonstrate  through  retest  R&M  growth  and  even¬ 
tual  design  maturity.  Figure  27  provides  an  exam¬ 
ple  reliability  growth  format. 

Sustain  Reliability  and  Maintainability  in 
Production  and  Service 

The  difference  between  inherent  (or  potential) 
R&M  values  and  achieved  values  is  shown 
graphically  in  Figure  28.  The  operation  and 
maintenance  of  equipment  in  the  field  can  induce 
these  effects  by  stressing  systems  beyond  predicted 
levels.  Contributors  to  these  overstresses  include 
neglect,  unfamiliarity,  carelessness  and  mission 


TjSS'J; 

w: 


Figure  27.  Example  of  a  Reliability 
Growth  Curve 


constraints.  And  the  real  reliability  can  be  obscured 
by  scheduled  and  unscheduled  maintenance  ac¬ 
tions.  For  example,  in  unscheduled  maintenance, 
trouble-shooting  might  include  installation  of  good 
parts  to  identify  bad  parts  (put  in  a  new  part  to 
see  if  that  cures  the  problem).  Even  though  the 
replacement  does  not  correct  the  problem,  the 
removed  part  may  get  written  up  as  defective  when 
it  is  in  fact  good  but  is  not  reinstalled.  These  parts 
then  may  be  returned  to  a  depot  or  discarded  thus 
contributing  to  a  report  of  lower  than  actual 
reliability  of  the  component  under  discussion. 


Scheduled  maintenance  can  also  induce  defects  in 
satisfactory  assemblies:  foreign  objects  left  inside, 
fasteners  improperly  tightened,  dirt  introduced,  im¬ 
proper  part  replacement,  improper  lubricants.  Of 
course,  a  major  effort  is  made  in  operations  to 
reduce  the  effects  of  reliability  degradation  caused 
by  maintenance.  The  point  here  is  that  the  designer 
should  consider  the  pitfalls  of  field  maintenance  and 
minimize  the  characteristics  of  the  design  which  are 
susceptible  to  operationally  induced  reliability 
deterioration.  And,  equally  important,  reliability 
predictions  and  allocations  should  be  made  on 
realistic  operational  projections  for  degradation. 

The  key  to  minimizing  and  controlling  R&M 
degradation  is  to  identify  defects  introduced  by  pro¬ 
duction  and  service  life.  Two  types  of  defects  must 
be  considered,  quality  defects  and  reliability 
defects.  Quality  defects  are  those  that  can  be 
detected  through  the  inspection  and  acceptance 
testing  program.  Reliability  defects  are  those  which 
require  stress  over  a  time  period  to  detect.  Some 
techniques  for  addressing  reliability  in  production 
and  in  service  are  shown  in  Figures  29  and  30. 

R&M  Summary 

Reliability  and  maintainability  are  dependent  upon 
specific  program  activities  with  objectives  as  in¬ 
dicated  in  Figure  31  and  performed  as  integral  parts 
of  the  system  acquisition  process.  A  handy  tool  for 
establishing  reliability  goals  and  thresholds  related 


Figure  28.  R&M  During  System  Life 
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to  operating  time  is  provided  in  Figure  32.  It  is  im¬ 
portant  that  R&M  be  considered  in  the  design  proc¬ 
ess  because  identification  of  related  problems  in 
later  stages  of  the  life-cycle  has  an  adverse  cost 
leverage  as  generally  shown  in  Figure  33. 

Designing  for  Production 

In  the  1970s,  some  major  DOD  programs  ran  into 
high-production  costs  and  significant  delivery 
schedule  problems,  in  large  measure  attributed  to 

Figure  29.  Techniques  for  a  Successful  Program 

Sustain  reliability  in  production  and  service 

•  Process  control 

•  Screening/acceptance  tests 

•  Burn  in 

Sustain  reliability  in  service 

•  Field  data 

•  Corrective  action 

•  Product  improvement  program 

•  Modifications 


lack-of-design  consideration  for  producibility,  and 
poor  planning  for  production.  The  phrase  "tran¬ 
sition  to  production"  was  coined  to  identify  a  quasi¬ 
program  phase  just  before  production.  This  ter¬ 
minology  has  left  a  wrong  impression  with  many 
in  the  acquisition  community  that  production  con¬ 
siderations  are  taken  seriously  only  when  factory 
start-up  is  imminent;  in  response,  the  Defense 
Science  Board  looked  at  Solving  the  Risk  Equation 
in  Transitioning  from  Development  to  Production 
(Reference  i).  Templates  for  addressing  that  type 
of  risk  were  developed  and  the  importance  of  pro¬ 
duction  consideration  throughout  the  program  was 

Figure  31.  Objectives  of  R&M  Activities 

•  Operational  Effectiveness 

•  Ownership  Cost  Reduction 

•  Limit  Manpower  Needs 

•  Management  Information 

•  Efficiency 


Figure  30.  Flow  Chart  of  Reliability  Program  Based  on  Field  Data 
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Figure  32.  Setting  Reliability  Goals  and  Thresholds 
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dearly  established.  Designing  for  production 
(which  starts  in  conceptual  identification  of  solu¬ 
tions  to  needs)  is  the  first  step. 

Definition  (Reference  j) 

Produdbility.  The  relative  ease  of  producing  an 
item  or  system.  This  is  governed  by  the 
characteristics  and  features  of  a  design  that  enable 
economical  fabrication,  assembly,  inspection,  and 
testing  using  available  production  techniques. 

. .ease  of  producing. ..."  recognizes  that  a  perform¬ 
ance  indicator  of  a  production  process  is  the  "ease" 
of  operation  which  can  be  observed;  e.g.,  grinding 
sparks  fly  as  excess  material  is  removed,  people 
weld  in  uncomfortable  positions  or  complicated  fix¬ 
tures  are  required  to  properly  position  parts  for 
joining.  This  issue  is  addressed  by  coupling  the 
design  and  manufacturing  process  and  then  con¬ 
tinuing  to  improve  the  quality  of  both. 

"...governed  by... design"  recognizes  that  the  design 
does  influence  ease  of  producing.  The  designer  must 


address  questions  like;  does  the  design /manufac¬ 
turing  tolerance  in  detail  parts  manufacture  per¬ 
mit  assembly  ease?  Does  the  design  consider  human 
factors  to  facilitate  assembly?  This  issue  is  also  ad¬ 
dressed  by  coupling  the  design  and  manufacturing 
process  and  then  continuing  to  improve  the  quali¬ 
ty  of  both  which  leads  to  another  interesting  phrase 
in  the  producibility  definition. 

"...inspection  and  testing...."  recognizes  that  the 
manufactured  product  must  be  inspectable  and 
testable.  Why?  To  be  able  to  assure  that  perform¬ 
ance  meets  requirements,  certainly.  But  it  is  impor¬ 
tant  to  look  at  more  than  the  quality  of  the  prod¬ 
uct,  equally  important  is  the  quality  of  the 
manufacturing  process.  Failure  analysis  should  ad¬ 
dress  both  quality  of  design  and  quality  of 
manufacturing  process  then  may  extend  to  the 
realism  of  the  requirement  and  address  what  is  real¬ 
ly  "fit  for  use." 

"...using  available  technology...."  recognizes  a  ma¬ 
jor  risk  area,  the  assurance  that  selected  techniques 


Figure  33.  Relative  Costs  of  Problem  Correction  versus  Program  Phase 


Program  phases 


will  be  successful  in  manufacturing  the  specific 
product  under  development.  The  span  of  considera¬ 
tion  is  not  a  narrow  window  as  the  system  transi¬ 
tions  to  production.  During  the  conceptual  cycle 
it  is  necessary  to  identify  and  institute  the  necessary 
development  programs  to  assure  that  required 
manufacturing  technology  is  available  when 
needed. 

Importance  of  Quantity,  Rate  and  Unit  Cost 
Goals  in  Design 

Instability  in  acquisition  goals  is  a  major  problem 
for  product  definition.  When  quantity,  rate  and 
unit  cost  are  identified,  the  design  is  coupled  with 
the  manufacturing  process  and  the  optimum  is 
largely  'locked  in"  for  the  given  parameters.  The 
related  logic  is  illustrated  in  Figure  34  (read  the  ar¬ 
rows  as  'largely  influence"  as  opposed  to  exact 
relationship). 


Establishing  quantity  and  rate  will  drive  capacity 
decisions  such  as  number  of  plants  or  production 
lines  required  and  configuration  (i.e.,  job  shop,  sta¬ 
tion  capability,  ordered  stations,  integrated  station 
flow,  automation)  of  the  facilities.  As  quantity  and 
rate  increase,  business  and  management  considera¬ 
tions  drive  the  facility  configuration  from  a  job 
shop  toward  high  technology  automation.  Ob- 


Figure  34.  Acquisition  Strategy 
Impact/on  Manufacturing 


— is-  Manufacturing  Coat 

Quantity.  Rata, /and  Unit  Cost  — 

viously,  a  major  trade-off  is  made  between  labor 
and  capital  investment.  A  current  approach  to 
adaptation  for  changes  as  well  as  achieving  low  and 
high  values  of  quantity  and  rate  is  the  development 
of  flexible  machining  centers  wherein  computerized 
and  automated  techniques  minimize  set-up  time 
and  cost.  As  computer  aids  become  increasingly 
economical,  the  installation  and  conversion  to  flex¬ 
ible  equipment  will  require  less  capital  and  the 
designer  will  have  more  latitude  to  involve  what 
are  now  generally  considered  high  quantity/rate 
low-cost  per  unit  manufacturing  processes. 
However,  in  the  remainder  of  this  decade 
establishing  quantity  and  rate  of  production  will 
have  a  significant  impact  on  identifying  the  op¬ 
timum  facility. 

Establishing  unit  cost  and  rate  will  affect  design 
decisions  such  as  types  of  casting  or  welding  to  be 
employed.  Design  and  manufacturing  process 
linkage  is  tight  for  these  examples  not  only  because 
the  design  must  contain  configuration  features  (e.g., 
draft  angle  in  castings,  joint  geometry  in  welding) 
peculiar  to  the  selected  process  but  also  because 
resulting  material  physical  properties  (and  thus  size 
and  weight)  are  sensitive  to  the  selected  detail  proc¬ 
ess.  To  minimize  impact  of  change,  the  designer 
must  consider  the  future  and  proportion  to  allow 
accommodation  of  the  widest  practical,  probable 


Establishing  quantity  and  unit  cost  will  affect  op¬ 
timum  manufacturing  cost  (defined  here  as  cost  to 
support  the  manufacturing  effort;  e.g.,  tools,  plan¬ 
ning,  process  description,  training).  Based  on 
givens,  decisions  will  be  made  such  as  whether  to 
develop  "hard  tools,"  a  detailed  process  and  train¬ 
ing  for  the  work  force  or  minimum  description  and 
tools  for  skilled  workers  in  a  "job  shop."  A  cur¬ 
rent  approach  to  flexibility  in  this  consideration  is 
the  application  of  computer  aids  in  developing 
tools,  plans,  and  documentation  and  the  establish¬ 
ment  of  a  flexible,  skilled  work  force  with  ap¬ 
propriate  labor  relations  to  allow  job  blending  and 
mobility. 

The  key  point  is  that  establishing  quantity,  rate  and 
unit  cost  will  largely  influence  (drive)  the  optimum 
manufacturing  process  which  likewise  depends 
upon  facilities,  design,  and  manufacturing  cost. 
Realistically,  during  the  program  life-cycle  changes 
in  procurement  strategy  do  occur  and  the  design 
should  be  developed  to  provide  flexibility  for  the 
most  effective  manufacturing  process.  It  is  impor¬ 
tant  that  the  program  office  develop  economic  rela¬ 
tionships  for  the  optimum  matching  of  design  with 
acquisition  strategy  and  be  prepared  to  track  and 
brief  the  economic  impacts  of  variations  in  quan¬ 
tity,  rate  and  unit  cost  goals. 


variation  in  optimum  manufacturing  process. 

Figure  35.  Soma  Consequences  of  Inadequate 
Manufacturing  involvement  During  Development 


•  Low-process  yields  —  High  scrap/rcwork  rstos 

•  Restricted  data  rights  and  non-standard  call-outs  —  Limited  availability  and  hi  costs  of  parts/componants 

•  Tbno-consumlng  adjustmonts/calbratlens  —  Prolonged  manufacturing  cycles  and  Increased  quantities  of  Instrumented 
equipment 

•  Difficult -te-machlne  shapes,  materials,  tolerances,  flnlshss  —  Unique  machining  capabilities 

•  Difficult  assembly  requlrements/soquences  —  Frustrate  use  of  automatic  assembly  techniques 

•  Unique  production  skM  —  Difficult  labor  rocrultmont/tralnlng 

•  Overly  stringent  or  ambiguous  acceptability  criteria  —  High  MRB  activity 

•  Optimistic  production  schedules  —  Schedule  slippages 


Coupling  the  design  and  manufacturing  process  is 
achieved  by  providing  the  environment  for  design 
engineers  and  manufacturing  engineers  to  work 
together.  This  team  addresses  issues  such  as  those 
listed  in  Figure  35. 

Low  Process  Yields 

A  significant  measure  of  a  manufacturing  process 
is  the  percentage  of  item  starts  that  complee  the 
process  (e.g.,  100  items  are  started  but  only  90  com¬ 
plete  the  process;  the  yield  is  90  percent).  Scrap, 
repair  and  rework  impact  the  process  efficiency. 
The  term  "hidden  factory"  has  been  coined  to 
describe  the  out-of-station  activity  (repair,  rework) 
established  by  U.S.  producers  to  keep  the  produc¬ 
tion  line  going.  The  hidden  operation  of  the  fac¬ 
tory  many  times  does  not  conduct  failure  analysis 
to  determine  cause  of  the  problem  and  then  cor¬ 
rective  action.  But  the  most  insidious  effect  is  the 
usual  lack  of  cost  accounting  which  masks  the  real 
(increased)  cost  of  (poor)  quality.  The  hidden  fac¬ 
tory  is  under  attack  as  counter-productive  based 
on  the  empirical  evidence  of  Japanese  success 
achieved  through  meticulous  dedication  to  perfec¬ 
tion  in  design  and  manufacturing  process.  The  wat¬ 
chwords  are  "fix  the  process"  (which  may  include 
fix  the  design)  and  "quality  (including  quality  of 
design)  yields  productivity." 

Restricted  Data  Rights  and 
Non-Standard  Call  Outs 

These  issues  are  listed  together  because  the  result 
for  DOD  is  similar,  sole  source  or  at  least  reduced 
competition.  The  first  issue  (restricted  data  rights) 
arises  through  incorporating  a  manufacturing  proc¬ 
ess  developed  by  the  contractor  which  is  claimed 
as  proprietary.  There  may  be  a  variety  of  reasons 
why  this  is  necessary  and  a  complete  discussion  of 
the  issue  is  beyond  this  scope.  If  practical,  the  con¬ 
dition  should  be  eliminated.  The  fundamental  point 
is  that  the  condition  should  be  identified  through 
requirements  for  identification  under  the  contract 
and  continual  vigilance  in  the  design  review  proc¬ 
ess.  Then  effective  action  can  be  taken  to  eliminate 
the  problem  by  purchasing  data  rights  or  requir¬ 
ing  design  change  or  managing  the  problem  by  buy¬ 
ing  out  life-cycle  support  requirements  or  plann¬ 
ing  and  budgeting  for  restricted  source.  In  any 


event,  the  problem  should  be  exposed  and  plans 
for  the  solution  developed  with  cognizance  of  ac¬ 
quisition  executives. 

Non-standard  call-outs  here  refer  to  components 
which  have  not  been  identified  and  selected  from 
the  standard  parts  list  developed  for  the  program 
or  which  have  not  been  altered  economically  to  be 
standard.  The  point  is  that  a  standard  parts  list 
should  be  developed  for  design  use  and  then  the 
team  should  effectively  apply  standards.  This  ac¬ 
tivity  can  be  managed  by  the  government  through 
requiring  program  office  non-standard  parts 
approval. 

Time-C  onsuming  Ad justments/  Calibrations 

This  issue  relates  to  both  the  product  design  and 
the  manufacturing  process.  A  design-related  exam¬ 
ple  is  lack  of  part  tolerance  control  or  very  tight 
assembly  tolerances  (or  both)  which  then  requires 
selection  of  components  for  assembly  (e.g.,  detail 
parts  with  measurements  to  obtain  a  specific  fit  in 
a  mechanical  device;  specific  electrical  value  of  a 
component  to  achieve  a  required  circuit  parameter). 
The  manufacturing  side  of  the  issue  relates  to  the 
techniques  for  verifying  the  process.  Calibration 
and  adjustment  of  test  equipment  are  typically  very 
important  and  very  costly  for  DOD  products. 
Therefore,  it  is  important  to  address  the  need  and 
productive  techniques  available  for  test  and  inspec¬ 
tion.  The  point  is  that  this  discipline  does  not  add 
value  to  the  product;  therefore,  design  adaption  to 
minimize  labor  in  process  verification  and  applica¬ 
tion  of  modem  test  and  inspection  technology  can 
improve  productivity  significantly. 

Difficult-to-Machine  Shapes, 
Materials,  Tolerances,  Finishes 

A  major  contribution  of  manufacturing  engineer¬ 
ing  to  the  early  design  process  should  be  descrip¬ 
tion  of  the  available  manufacturing  processes  and 
capabilities.  The  designer  should  then  define  a 
product  which  can  be  produced  with  these  proc¬ 
esses  or  identify  shortfalls  for  economic  analysis 
to  determine  appropriate  action  for  process 
development  or  design  change. 

Difficult  Assembly 
Requirements/Sequences 

The  assembly  activity  is  usually  labor  intensive  and 
difficult  to  estimate  in  early  stages  of  development. 


Figure  36.  Dlstractors  to 
Doslgn  lor  Producfblllty 


•  PMO  FOCUS 

—  Short-term  forced  by  environment 
—  Long-term  (not  required) 

•  CONTRACT  REQUIREMENTS 

—  Cost 
—  Schedule 
—  Performance 

•  LAWS 

-  OSHAandEPA 


Therefore,  producibility  review  involving  design 
and  manufacturing  is  particularly  important  for 
assembly  requirements.  "If  you're  going  to  use 
robots,  design  for  robots"  makes  some  sense. 
Manufacturing  engineers  looking  at  the  design  from 
an  assembly  point  of  view  can  bring  considerable 
insight  to  the  process  (e.g.,  placement  of  fasteners 
to  facilitate  manual  or  automatic  installation, 
clearances  to  permit  use  of  standard  tools  and  test 
equipment). 

Unique  Production  Skill 

If  the  "optimized  process"  requires  a  skill  not  resi¬ 
dent  with  the  producer,  a  whole  new  set  of  prob¬ 
lems  arise— recruitment,  training,  and  inserting  the 
skill  in  the  labor  relations  scheme.  Producibility 
review  should  identify  this  type  of  problem.  Then 
change  the  process  to  eliminate  the  need  or  plan 
to  acquire  it. 

Figure  37.  Motivation  to  Design  for  Producibility 


•  The  product  Is  noodod,  fulfills  requirement 

•  Evolution  Is  expensive 

•  Objective  of  design  phase  Is  manufacturing 

•  Producibility  enhances  program  longevity 
Key  point 

Motivation  should  be  to  design  for  producibility 


Overly  Stringent  or  Ambitious 
Acceptability  Criteria 

Everyone  involved  in  the  production— designer, 
product  assurer,  manufacturing  processor,  gage 
maker,  tester— wants  a  "safety  margin."  If  each  one 
takes  10  percent  extra  to  assure  meeting  the  require¬ 
ment,  it  is  tightened  well  over  50  percent.  This  type 
of  well-intentioned  thinking  contributes  to  rejec¬ 
ting  parts  and  assemblies  that  are  acceptable  quali¬ 
ty.  This  aggravates  the  hidden  factory  phenomena 
described  above  and  as  a  minimum  increases  in¬ 
spection  and/or  test  rejections  handled  by  material 
review  board  (MRB)  action  which  then  finds  the 
part  or  assembly  "acceptable  as  is."  Before  this  oc¬ 
curs,  the  design /manufacturing  review  process 
should  expose  the  problem  for  correction.  (If  it  oc¬ 
curs  in  production,  the  MRB  manufacturing 
representative  should  rightfully  ask:  "Why  don't 
you  change  the  requirement?") 

Optimistic  Production  Schedules 

Commitments  to  production  schedules  in  support 
of  the  fielding  plan  are  typically  made  before  the 
detailed  design  is  anywhere  near  completion.  Since 
there  is  pressure  to  tell  buyers  what  they  want  to 
hear,  production  planners  must  work  closely  with 
designers  in  early  development  to  understand  and 
justify  production  process  requirements  and 
schedule  allocations  in  a  better  way.  Simple  lack 
of  execution  at  the  component  level  can  reflect 
serially  through  system  fabrication,  having  drastic 
schedule  and  cost  implications.  Strategic  implica¬ 
tions  can  be  critical;  e.g.,  the  world  was  waiting 
for  Pershing  II  to  be  on  time. 

Producibility  Distractions 

Though  the  design  for  producibility  techniques  are 
relatively  straightforward  and  simply  stated,  there 
are  serious  distractors  (Figure  36)  for  both  the 
government  and  the  contractor.  Realistically,  there 
never  seems  to  be  enough  resources  to  do  the  job. 
Where  are  these  skilled  production  analysts  that 
can  help?  And  if  they  can  be  found,  where  is  the 
money  to  support  them?  The  pressure  to  define 
something  that  works  and  show  performance  over¬ 
whelms  long-term  reasoning.  What  is  long  term? 
With  3-4  year  duty  rotation,  fruits  of  development 
may  never  be  seen  in  production.  The  response, 
of  course,  is  that  producibility  engineering  and 
planning  (PEP)  is  really  not  an  optional  activity; 
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it  will  be  conducted  early  and  effectively  or  later  Motivation 

in  piecemeal  fashion  with  great  agony  and  expense.  Many  in  the  DOD  acquisition  community,  who 
The  DOD  program  office  and  the  contractor  must  point  accusing  fingers  saying  contractors  are  in- 
identify  the  need,  establish  the  requirements  to  ac-  terested  only  in  maximum  sales  and  profits,  assume 
complish  the  goals,  and  diligently  defend  the  ac-  there  is  no  incentive  for  low-production  costs.  To 
quired  resources  to  assure  that  the  required  tasks  examine  this  accusation,  consider  the  logic  of  Figure 
are  accomplished.  37  Presumably,  the  product  is  needed;  it  fulfills 

Given  a  development  contract  with  defined  cost,  a  requirement.  We  are  a  needs-driven  society.  This 
schedule  and  performance  requirements,  there  are  tbe  ^abr'c  our  society  a  concept  most  of  us 
watchbirds  and  alligators  everywhere.  If  there  isn't  have  embraced.  Evolution  is  expensive  (read  evolu- 
ample  management  reserve  to  cover  hard-to-predict  bon  as  iteration  if  it  is  clearer,  the  concept  of  'here  s 

("unknown  unknowns")  shortfalls  in  these  areas,  30  aPProacb,  can  you  build  it;  no,  okay,  1 11  change 

temptation  to  allocate  from  producibility  studies  *t;  bow  s  ).  Design  changes  to  improve  pro¬ 

will  be  great.  Who  will  say:  Stop,  stretch  schedule,  ^ucibility  after  production  start  require  alteration 
send  more  money  now  and  you'll  get  it  back  later  configuration  controlled  drawings  and  can  re¬ 
in  improved  producibility?  The  program  office  Quire  changes  in  the  support  plans  and  equipment, 
must  believe  in  design  for  producibility  and  sup-  sPares,  and  other  logistic  resources.  It  is  recognized 

ply  the  incentives  and  resources  to  see  that  it  oc-  ^ba*  changes  for  producibility  will  be  resisted 

curs.  One  technique  is  a  formal  Producibility  ^  msV-  in  fact-  be  uneconomical  due  to  early 
Engineering  and  Planning  Program  (Reference  k).  fixed  commitments  for  operation.  Fortunately,  the 
The  alternative,  a  less  formal  approach,  should  en-  designer  should  recognize  that  the  objective  of  the 
compass  the  principles  presented  in  References  (i)  design  phase  is  manufacturing, 
and  (k)  as  generally  outlined  in  this  section.  A  simple  model  designers  use  is  shown  on  Figure 
Influences  upon  design  and  manufacturing  38.  First,  the  product  design  (which  meets  perfor- 

engineering  may  come  from  external  sources.  Ex-  mance  requirements)  and  manufacturing  process 

amples  are  regulations  from  the  occupational  safety  Figure  38.  Design  for  Producibility  Model 
and  health  administration  (OSHA)  and  the  en¬ 
vironmental  protection  agency  (EPA).  New  regula¬ 
tions  or  alerts  requiring  immediate  attention  may 
arise  in  the  middle  of  a  program.  An  OSHA  ex¬ 
ample  might  be  the  identification  of  a  carcinegenous 
material  used  in  the  program  and  the  resulting  re¬ 
quirement  to  protect  humans  from  the  effects,  an 
endeavor  which  could  obviously  seriously  effect 
cost,  schedule  and  performance.  Examples  of  EPA 
concern  might  be  environmental  impact  from  a 
planned  new  manufacturing  facility  and  disposal 
of  toxic  manufacturing  process  materials.  These 
issues  are  relatively  common  and  can  have  serious 
program  overtones.  The  point  is  that  the  program 
office  must  have  a  source  for  continual  vigilance 
in  these  areas.  Typically,  major  contractors  have 
functions  responsible  for  these  issues  and  track 
them  as  a  matter  of  doing  business  and  in  response 
to  contracts  which  require  conformance  to  OSHA 
and  EPA  regulations.  The  services  also  review 
drawings  for  regulation  conformance  but  too  late 
to  have  the  desired  early  effect  on  producibility 
design. 
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are  coupled  through  consultation  with  functional 
experts.  The  formal  programs  which  establish  goals 
and  fund  actions  for  producibility  include  pro- 
ducibility  engineering  and  planning  (PEP)  and  in¬ 
itial  production  fadlities  (IPF).  Using  a  work 
breakdown  structure,  the  elements  of  the  design  are 
defined  and  an  associated  cost  for  each  estimated. 
Then  the  designer  attacks  the  leverage  elements, 
that  is,  the  high  value  items,  particularly  those  that 
appear  costly  for  their  function. 

The  implication  of  PARETO  is  that  if  the  items  are 
placed  in  order  of  cost  from  highest  to  lowest,  then 
the  top  20  percent  will  cover  80  percent  of  the  total 
cost.  Focus  on  the  top  20  percent  in  order  of  cost 
is  a  common  technique  for  considering  leverage  but 
there  are  other  important  considerations  as  in¬ 
dicated  in  Figure  38  and  the  job  is  not  complete  un¬ 
til  all  items  are  considered  in  the  proper  system 
perspective.  For  this  type  of  analysis,  there  is  a 
distinction  to  be  made  regarding  design  for  a  type 
of  cost,  design  to  unit  production  cost  (DTUPC) 
and  design  to  life-cycle  cost  (DTLCC).  The 
minimum  unit  production  cost  estimate  may  not 
always  yield  the  minimum  life-cycle  cost  estimate. 
Therefore,  the  designer  will  have  to  receive  guid¬ 
ance  regarding  the  priority. 


Figure  39.  Program  for  Producibility 


Returning  to  the  logic  of  motivation  outlined  in 
Figure  37,  the  contractor  marketing/sales  functions 
should  recognize  that  producibility  enhances  af¬ 
fordability  which,  in  turn,  enhances  program 
longevity.  What  better  reasons  to  motivate  the  key 
players?  The  point  is  that  contractors  do  have 
motivation  to  design  for  producibility.  It  is  general¬ 
ly  the  instability  of  requirements  and  lack  of  pro¬ 
gram  office  focus  on  producibility  that  stifles  the 
inherent  motivation.  The  program  office  must  pro¬ 
vide  a  stable  acquisition  strategy  and  execute  an 
effective  program  which  provides  necessary 
resources  to  design  for  producibility.  A  general 
outline  for  a  producibility  program  is  shown  on 
Figure  39;  details  can  be  found  in  References  (i), 
(k)  and  (1). 

Design  for  Producibility  Summary 

The  acquisition  strategy  which  defines  quantity, 
rate  and  unit  cost  goals  largely  influences  the  op¬ 
timum  production  process.  Therefore,  the  program 
office  should  provide  a  stable  acquisition  strategy 
and  then  enhance  inherent  motivation  for  pro¬ 
ducibility.  Specifically,  the  product  design  and  pro¬ 
duction  process  should  be  coupled  through  effec¬ 
tive  design  and  manufacturing  engineer  consulta¬ 
tion  on  issues  such  as  those  shown  on  Figure  35. 
The  process  is  managed  by  establishing  a  program 
responsive  to  References  (i),  (k)  and  (1)  which  will 
include  a  series  of  dpsign  reviews  to  confirm  that 
producibility  issues  have  been  exposed  and 
resolved. 

Designing  for  Special  Systems  Requirements 

The  design  is  influenced  by  many  requirements 
special  to  the  specific  system  under  development. 
A  representative  list  of  specialties  includes: 

*  System  Safety 

*  Human  Engineering 

*  Electromagnetic  Compatibility  (EMC)  and 

Interference  (EMI) 

*  Contamination  and  Corrosion  Control 

*  Survivability  and  Vulnerability 

*  Hardware/Software  Integration 

*  Operation  and  Support 

System  Safety 

This  is  the  engineering  process  which  identifies, 
evaluates  and  controls  hazards  throughout  the  life- 
cycle  of  the  system.  It  includes  anything  that  could 
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cause  or  prevent  accidents  (hardware,  software, 
people,  environment).  Tasks  include  hazard  analy¬ 
ses  during  design,  development  and  test,  surveys, 
investigations,  and  preparation  of  accident  plans. 

Obviously,  this  activity  is  extremely  important  for 
the  health  and  well-being  of  users  and  the  com¬ 
munity  at  large.  But  the  economic  implications  are 
also  important  as  indicated  in  Figure  40. 

Safety  engineering,  which  integrates  design  for 
minimum  hazards,  is  detailed  in  Figure  41  (recall 
the  relationship  to  failure  modes,  effects  and 
criticality  analysis  covered  in  relation  to  Figure  18). 
The  hazards  are  defined  through  a  series  of  analyses 
listed  in  Figure  42.  Residual  risks  are  determined 
and  design  goals  are  established  in  a  manner  il¬ 
lustrated  in  Figure  43.  When  a  design-related  safe¬ 
ty  problem  is  identified,  the  scientific 
method/system  engineering  will  require  definition 
of  alternatives  that  will  control  the  condition. 
Priority  ranking  used  to  select  one  of  the  design 
alternatives  can  be  established  by  the  technique  il¬ 
lustrated  in  Figure  44. 

Human  Engineering  (Reference  m) 

Human  engineering  specialists  address  the  people- 
equipment  interface.  They  apply  principles  of 
human  capability  (to  reach,  lift,  see,  communicate, 
comprehend,  and  act)  to  the  functions  and  cir¬ 
cumstances  required.  They  are  another  team 
member  in  the  design  process  whose  goal  is  to  op¬ 
timize  the  system.  They  first  allocate  systems  to 
personnel,  equipment,  software,  or  facilities.  The 
level  of  involvement  and  criticality  of  personnel 
tasks  are  identified.  Human  factors  engineers  then 
use  task  analysis  and  time-line  studies  to  determine 
if  human  capabilities  will  be  exceeded.  They 
prepare  models  and  mockups  to  evaluate  alter¬ 
native  designs  or  concepts  and  for  dynamic  simula¬ 
tion  of  critical  human  performance.  Human 
engineering  specialists  work  with  design,  system 
safety,  maintainability,  testing,  training,  produc¬ 
tion,  subcontractors,  deployment,  logistic  support, 
and  operations  personnel.  Focusing  program  atten¬ 
tion  on  protection  of  personnel  from  hazardous  en¬ 
vironmental  conditions  is  their  most  important 
activity. 


Figure  40.  Two  Safety  Approaches 


Figure  41 .  System  Safety 
Engineering  and  Precedence 

•  Identify  Hazards  in  the  System 

•  Define  Hazards  in  terms  of  Severity  and  Probability 

•  Design  for  Minimum  Hazard,  within  the  Con¬ 
straints  of  Operational  Effectiveness.  Time  and  Cost 

•  Control  Remaining  Hazards,  with  Safety  Devices, 
Warning  Systems,  and  Operating  Procedures 

•  Understand  and  Accept  Residual  Risks 


Figure  42.  Hazard  Analysis 

PHA  -  Preliminary  Harzard  Analysis 
SSHA  -  Subsystem  Harzard  Analysis 

-  Fault-Hazard  Analysis 
•  Fault-Tree  Analysis 

-  Sneak-Circuit  Analysis 
SHA  -  System-Hazard  Analysis 

O&SHA  -  Operating  and  Support-Hazard  Analysis 


Figure  43.  Risk  Design  Goals 
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Figure  44.  Sample  System  Safety  Ranking  for  Implementation 
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EMC/EMI  (Reference  n) 

Unintentional  electromagnetic  radiation  can  cause 
unacceptable  degradation  (e.g.,  interference  to  elec¬ 
tronic  equipment  within  range  or  initiation  of  elec¬ 
troexplosive  devices).  Electromagnetic  compatibili¬ 
ty  is  achieved  by  eliminating  or  controlling  uninten¬ 
tional  radiation  to  an  acceptable  level  or  by 
shielding  equipment  from  its  effects.  Protection 
from  lightning  and  static  discharges  are  included 
in  this  discipline. 

EMC/EMI  specialists  address  electromagnetic 
sources  of  radiation  within  the  system  such  as: 
motors,  generators,  power  sources,  signal  and 
power  wiring,  transformers,  and  relays.  They 
develop  design  criteria  to  minimize  potential  prob¬ 
lems  related  to  items  such  as  radiation-shielding, 
bonding,  lead  lengths,  wire  routing,  component 
placement,  and  decoupling.  It  is  usually  necessary 
to  perform  a  detailed  analysis  of  the  electrical 
power  system  to  determine  power  bus 
characteristics  and  dynamic  impedance  and  to 
evaluate  any  undesirable  steady  state  or  transient 
effects.  Development  and  qualification  tests  include 
EMC/EMI  tests  to  measure  unintended  radiation 
and  its  effects. 

Contamination  and  Corrosion  Control 
(Reference  o) 

Several  types  of  manufacturing  require  contamina¬ 
tion  control.  Semiconductors,  microelectronics, 
and  precision  bearings  are  examples  that  require 
atmospheric  control  of  airborne  particles  and  con¬ 


trol  of  surface  contaminants  Equipment  applica¬ 
tions  and  environments  may  require  moisture, 
fungus,  and  corrosion  prevention  techniques  in 
design,  manufacturing  and  surface  protection. 

The  advent  of  space  systems  and  the  Space 
Transportation  System  has  resulted  in  system  ap¬ 
plication  requirements  for  contamination  controls 
which  far  exceed  other  system  applications  in  com¬ 
plexity  and  mission  critical  consequences.  Ultra¬ 
cleanliness  is  important  but,  in  addition,  space- 
induced  and  operationally-induced  contaminants 
are  critical  to  instruments  and  optics.  For  exam¬ 
ple,  outgassing  of  materials,  volatile  condensable 
materials,  and  the  output  of  upper  stage  propul¬ 
sion  devices  are  some  of  the  contaminants  which 
must  be  controlled. 

Military  equipment  operates  under  the  most  dif¬ 
ficult  environments  imaginable.  Extremes  of 
temperature,  humidity,  sand,  dust,  salt  spray,  and 
rain  all  tend  to  debilitate  equipment  rapidly. 
Without  proper  resistance  or  protection,  much 
equipment  would  fail  to  function  when  required. 
Protection  must  be  provided  by  the  proper 
specification  of  materials,  covers  and  seals,  packag¬ 
ing,  heating  and  cooling  devices,  or  other  design 
features  which  permit  extended  storage  and  opera¬ 
tion  throughout  the  range  of  operational  en¬ 
vironments.  Once  a  qualification  unit  has  been 
built,  it  must  be  subjected  to  tests  which  encom¬ 
pass  the  full  range  of  environmental  requirements, 
plus  a  margin  of  safety  or  derated  performance 
criteria  (as  covered  in  Figure  6). 


Figure  45.  Survivability 
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THE  CAPABILITY  OF  A  WEAPONS  SYSTEM  TO  WITHSTAND  MAN-MADE  HOSTILE  ENVIRONMENT  WITHOUT 
SUFFERING  AN  ABORTIVE  IMPAIRMENT  OF  ITS  ABILITY  TO  ACCOMPLISH  ITS  DESIGNATED  MISSION 
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Survivability /Vulnerability 

Military  systems  are  vulnerable  to  the  natural  en¬ 
vironment  of  ground  or  space  and  to  hostile  threats 
from  ground  forces,  sea  forces,  air  forces,  and  anti¬ 
satellite  weapons  or  nuclear  detonations.  Specialists 
in  survivability/vulnerability  engineering  analyze 
and  evaluate  these  natural  and  induced  threats  in 
the  concept  exploration  phase  to  determine  the 
design  approach  and  methods  required  to  meet  sur¬ 
vivability  requirements  which  are  then  included  in 
the  system  soecification.  Figure  45  shows  the 
analytical  approach  for  evaluating  the  manmade 
hostile  environment  and  Figure  46  illustrates  the 
design  approach  to  countering  the  threat— hard  to 
find,  difficult  to  hit,  hard  to  damage,  easy  to 
repair— which  includes  considerations  for  detec¬ 
tion,  evasion,  and  damage  as  outlined  in  Figure  47. 

Specialists  analyze  the  vulnerability  of  the  system 
in  terms  of  the  capability  of  parts  and  materials, 
protective  measures,  system  architecture,  functions, 
and  controls.  Risks  and  alternatives  are  assessed 
in  trade-off  studies  which  lead  to  design  criteria  and 
decisions  to  reduce  vulnerability  and  improve  sur¬ 
vivability.  A  list  of  survivability  and  vulnerabili¬ 
ty  trade-offs  is  included  in  Figure  48. 

Nuclear  survivability  and  vulnerability  are  special 
concerns  for  many  systems.  The  threat  is  general¬ 
ly  depicted  in  Figure  49.  Design  techniques  for  ad¬ 
dressing  the  strategic  and  tactical  threats  are  beyond 
the  scope  of  this  document. 

Figure  46.  Design  Approach 

•  HARD  TO  FIND  •  HARD  TO  DAMAGE 

•  DIFFICULT  TO  HIT  •  EASY  TO  REPAIR 
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Hardware/Software  Integration 
(Reference  p) 

The  primary  instrument  of  hardware/software  in¬ 
tegration  is  the  hardware/software  Interface  Con¬ 
trol  Document  (ICD).  The  ICD  is  required  to 
specify  the  functional  interface  between  the  com¬ 
puter  program  product  and  any  equipment  hard¬ 
ware  with  which  it  must  operate.  It  is  often  true 
that  the  supplier  documentation  for  standard  com¬ 
puter  peripherals  and  terminals  is  adequate  for  this 
purpose.  Conversely,  it  has  been  found  that  per¬ 
formance  specifications  governing  the  design  of 
new  equipment  is  not  satisfactory  for  use  as  a  func¬ 
tional  ICD.  The  purpose  of  an  ICD  is  to  com¬ 
municate  interface  requirements  to  programmers 
on  terms  that  the  programmers  readily  and  ac¬ 
curately  understand  and  to  require  equipment 
designers  to  consider  the  impact  of  their  design  on 
computer  programs. 

The  ICD  provides  an  exact  definition  of  every  in¬ 
terface,  by  medium  and  by  function,  including  in¬ 
put/output  control  codes,  data  format,  polarity, 
range,  units,  bit  weighting,  frequency,  minimum 
and  maximum  timing  constraints,  sequence  or 
ordering  constraints,  legal/illegal  values,  and  ac¬ 
curacy,  resolution,  and  significance.  Existing 
documentation  may  be  referenced  to  amplify  ex¬ 
planations  of  the  effect  of  input/output  operations 
on  external  equipment.  Testing  to  validate  the  in¬ 
terface  designs  is  also  required. 

Figure  47.  Survivability/ Vulnerability 
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Figure  48.  S/V  Tradeoffs 
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the  logistic  needs  and  constraints  in  the  system  must 
be  established  early.  The  resulting  design  will  af¬ 
fect  (Reference  q): 

*  Using  personnel  in  terms  of  quantity,  type, 
and  required  training 

*  Support  equipment  in  terms  of  quantity  and 
level  of  technology  (which  effects 
equipment  cost,  operating  cost,  and  train¬ 
ing  cost) 

*  Supply  (which  effects  quantity  of  spares,  the 
system  to  handle  them  and  the  system  to  use 
them). 


Operation  and  Support 

The  majority  of  life-cycle  cost  is  spent  on  opera¬ 
tion  and  support.  Therefore,  issues  related  to  per¬ 
sonnel  and  training,  support  equipment,  and  sup¬ 
ply  should  impact  the  design  early  and  effective¬ 
ly.  To  do  this,  "design  to"  requirements  relating 


Designing  for  Cost  Objectives 

Design-to-cost  (DTC)  often  gets  bogged  down  in 
definitions  and  cost  accounting.  Capriciousness  is 
encountered  such  as  showing  conformance  to  goals 
by  juggling  books  while  ignoring  the  principles.  The 
thrust  here  is  to  cover  what  the  designer  does 


Figure  49.  Nuclear  Threat 
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Figure  50.  Life-Cycle  Cost  Composition 
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(review  Figure  38)  not  what  the  accountants  do, 
and  the  following  is  offered  for  the  clarity  of 
purpose. 

DOD  clearly  provides  guidance  that  life-cycle  cost 
considerations  are  important  in  early  design  phases 
and  should  be  used  to  develop  effective  systems. 

(Reference  r)  During  each  acquisition  phase, 
engineers  and  managers  shall  provide  prompt  feed¬ 
back  on  the  current  status  of  DTC  forecasts  and 
timely  estimates  of  the  costs  of  new  or  alternative 
designs  or  other  economical  solutions.  Engineers 


and  managers  shall  achieve  a  proper  balance  in 
DTC  emphasis  between  acquisition  and  operation 
and  support  (O&S)  costs. 

(Reference  s)  Tracking  of  DTC  status  (whether  in 
terms  of  dollars  or  other  measurable  factors)  shall 
continue  until  DTC  parameters  are  met.  For  pro¬ 
duction,  this  could  occur  when  actual  costs  for  the 
specified  DTC  quantities  have  been  reported  and 
compared  to  stated  DTC  parameters.  For  O&S, 
tracking  shall  continue  until  the  level  of  achieve¬ 
ment  can  be  determined  in  circumstances  that  ap¬ 
proximate  a  mature  operating  environment. 


Figure  51 .  Design  Linkage 
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When  goals  are  set,  they  should  be  based  on  the 
boundaries  identified  in  Figure  50  which  shows  life- 
cycle  cost  composition.  This  will  be  effective  if  a 
single  authority  (designer,  contractor,  program  of¬ 
fice,  service  executive)  will  assume  responsibility 
for  establishing  specific  DTC  goals  and  tracking  im¬ 
pact  of  proposed  designs  through  the  life-cycle  cost 
composition.  Figure  51  shows  design  linkage  with 
operation  and  support  cost  drivers. 

This  leads  to  equal  consideration  for  cost  along 
with  performance,  supportability  and  schedule.  In 
turn,  design-to-cost  becomes  part  of  the  system 
engineering  process  (Figure  52).  Specifically,  when 
goals  are  set  they  are  based  on  designer's  concepts, 
and  estimates  to  support  the  goals  are  developed 
using  the  best  tools  available.  As  the  design  is  refin¬ 
ed,  more  details  become  available  and  the  estimate 
can  be  refined.  Figure  53  is  an  example  format  for 


Figure  52.  Implementating  Design-to-Cost 
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Figure  53.  Subsystem  Managers  are  Responsible  for  Key  DTC  Parameters 
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Figure  54.  The  Name  of  the  Game 


reliability,  maintainability,  cost  input/output 
checks  and  balances),  and  an  effective  system 
security. 


breaking  down  a  design  and  allocating  difficult,  but 
achievable,  goals.  The  designer  responds  to  this 
type  of  system  engineering. 

Managing  the  Design 

Thus  far,  design  considerations  have  been  covered 
as  separate  topics.  In  the  final  analysis  designing 
is  a  big  trade-off  game  with  cost  at  the  center 
(Figure  54).  It  must  be  conducted  by  a  capable 
source  familiar  with,  and  responsive  to,  the  DOD 
review  process. 

Source  Selection.  Obviously,  the  search  is  for  the 
source  that  has  the  tools  and  talent  for  the  job,  at 
the  right  price.  Evaluators  should  address  design 
took  in  terms  of  productive  capacity  to  do  the  job, 
ability  to  generate  alternatives  and  support  trade¬ 
offs,  and  compatibility  of  data  output  with  system 
requirements.  The  designers  (talent)  must  be  adept 
at  using  the  tools  and  experienced  in  the  system 
design  process.  For  the  foreseeable  future,  design 
rooms  will  exhibit  considerable  turmoil  in  bring¬ 
ing  new  tools  and  talent  on-line.  Source  selection 
should  be  considered  whether  such  turmoil  is  under 
control— a  mix  of  experience,  employee  satisfac¬ 
tion  as  evidenced  by  low  turnover,  functional  in¬ 
tegration  (performance,  quality,  producibility. 


Design  Reviews.  The  design  reviews  are  the  basic 
tools  through  which  the  manager  controls  the 
design.  But,  as  is  the  case  with  most  program 
review  points,  if  a  problem  is  identified  first  at  the 
review,  then  communication  has  been  lacking. 
Continuing  communication  about  design  status  bet¬ 
ween  buyer  and  seller  is  required  largely  because 
of  the  dynamic  and  complex  nature  of  DOD 
systems  and  their  relationship  to  the  external  ac¬ 
quisition  environment;  e.g.,  the  Congress,  ad¬ 
ministration  and  changing  threats.  However,  the 
design-review  process  shown  in  Figure  55  offers  a 
convenient  framework  to  put  product  definition  in 
perspective  within  the  system  engineering/technical 
management  process.  Appendix  C  discusses  Figure 
55  in  depth  and  puts  product  definition  in  perspec¬ 
tive  as  the  common  thread  in  technical  manage¬ 
ment  life-cycle  activities. 

Product  Definition  Action.  The  following  are  of¬ 
fered  as  considerations  in  managing  design  action: 

*  Tasks  are  phase  dependent 

*  Avoid  self-imposed  constraints 

*  Establish  a  schedule 

*  Form  a  multidisciplined  team 

*  Work  hard  on  source  selection 

*  Define  production  cost  goal 

*  Establish  warranty  position 

*  Define  O&S  cost  elements  that  are  program 
cost  goals 

*  Analyze  incentives  in  depth 

*  Focus  on  cost  early 

*  Identify  cost  elements  to  be  considered 

*  Establish  difficult,  but  achievable,  goals 

*  Make  provisions  for  change 

*  Provide  flexibility 

*  Establish  feedback  mechanisms 

*  Do  risk  assessment 

*  Conduct  in-process  reviews. 

We're  asking  the  designer  to  sit  at  the  center  of 
generative  design  loops  shown  in  Figure  4  and  in- 
terate  and  iterate  until  the  optimum  solution  ap¬ 
pears.  It  is  a  formidable  task,  which  computers 
should  make  easier  from  the  standpoint  of  pro¬ 
viding  needed  data  on  a  more  real-time  basis.  It 
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is  the  manager's  job  to  see  that  the  required  data 
is  being  supplied  in  a  timely  fashion  and  that  the 
designer  is  using  it.  The  ultimate  check  will  occur 
when  actual  measures  of  a  program  are  accumu¬ 
lated,  but  that  will  be  far  too  late  for  effective 
management  action. 

The  State  of  the  Art  in  DOD  Product  Design 

Implementation  of  product  design  is  undergoing 
rapid  change.  Drafting  tools  are  changing  from 
manual  (remember  T  squares,  pencils,  and  slide 
rules?)  to  computer  aided  (Figure  56).  Data  inputs 


are  increasing  in  detail  and  speed.  Complex  rela¬ 
tionships  can  be  explored  in  great  depth.  There  is 
a  new  generation  of  designers  adept  at  using  the 
new  tools  and  integrating  computer  inputs.  This 
new  generation  is  an  unfamiliar  force  in  de¬ 
sign/drafting — a  force  which  must  be  reckned  with 
in  "people  management"  and  technical  manage¬ 
ment. 

Design  Tools 

The  interrelationships  among  conceptual  design, 
preliminary  design  and  production  design  of  an  air- 


Figure  55.  Acquisition  Life-Cycle  Technical  Activities 
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craft  are  illustrated  in  Figure  57.  The  area  through 
the  middle  is  accomplished  through  first  genera¬ 
tion  computer  aided  design  (CAD) .  As  CAD  moves 
into  the  second  and  third  generations,  all  the  tasks 
are  accomplished  "real  time"  through  CAD  and 
associated  analysis. 

First  generation  CAD  provides  descriptive 
geometry  on  an  interactive  graphics  terminal.  This 
essentially  allows  the  designer  to  shape/size/dimen¬ 
sion  a  given  part  using  the  computer.  The  second 
generation  of  CAD  adds  three  dimensional 
methodologies  to  provide  improved  visualization 
of  the  design.  Third  generation  CAD  brings  three 
dimensional  modeling  together  with  analytical  and 
simulation  models  to  allow  the  designer  to  "stress 
and  test"  the  design  before  finalization— even  to 
the  point  of  precluding  the  need  for  (some)  hard 
mockups. 


CAD  investments  in  products  that  improve  the  im¬ 
plementation  of  the  design  concept,  compared  to 
manual  methods,  have  shown  impressive  payoffs 
in  productivity  (Reference  t).  Among  the  reasons 
for  this  are:  Complex  construction  drawings  can 
be  done  faster  with  a  computer,  repetitive  construc¬ 
tion  entities  do  not  have  to  be  redrawn  (can  be  call¬ 
ed  instantaneously  from  storage),  geometry  con¬ 
struction  drawings  can  be  directed  by  the  computer 
(do  not  have  to  be  calculated),  and  a  designer's  use 
of  a  Cathode  Ray  Tube  (CRT)  in  an  interactive 
mode  is  more  intense  and  sustainable  than  a 
designer  working  at  a  drawing  board. 

Even  higher  productivity  can  be  achieved  through 
use  of  larger  data  bases  to  support  designs  from 
commonly  used  information,  creation  of  families 
of  drawings  from  layouts,  deriving  assembly  details 
from  the  same  geometric  data  base,  and  avoiding 


Figure  56.  Shown  at  the  left 
is  Computer-aided  Design 
performed  on  an  Advanced 
Roster  Workstation  (ARW) 
capable  of  three-dimensional 
formations  with  the  touch  of 
the  key  pad. 
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design  errors  in  motion  clearances  and  tolerances 
through  computer  accuracy.  In  addition  to  improv¬ 
ing  the  development  of  drawings,  the  automatic 
calculation  and  display  capabilities  of  CAD  are 
useful  and  effective  as  inputs  for  determining 
characteristics  like  section  properties,  weight, 
volume,  and  finite  surface  configurations.  Using 
CAD  graphics  to  assist  engineering  analysis  reduces 
mistakes  in  the  complex  manipulation  of  geometric 
data. 

Thus,  computers  have  a  tremendous  productive 
promise  and  they  do  very  well  the  evolutionary 
task  of  product  definition  within  given  constraints 
(e.g.,  as  long  as  the  system  architecture  and  data 
base  are  appropriately  maintained).  So  the  program 
writers  are  key.  They  lock  in  the  design  choices 
and,  other  than  eternal  vigilance,  there  is  no  way 
to  test  the  output  relative  to  current  technology 
choices  and  system  interfaces.  People  forget  func¬ 
tional  dependencies  because  of  the  magnitude  of 
the  data  involved.  This  pitfall  will  get  deeper  with 
time  as  more  and  more  interfaces  and  data  inputs 
are  related  to  the  design  data  base.  Ironically,  this 
will  put  computers  in  the  role  of  limiting  advances 
unless  the  pitfall  is  addressed. 


CAD  Linkage  to  Computer-Aided 
Manufacturing  (CAM) 

Emphasis  on  productivity  improvement  is  directed 
at  the  manufacturing  process  because  the  tasks  are 
typically  repetitive  and  labor  intensive  and  because 
manufacturing  costs  of  DOD  defense  systems  are 
generally  three  times  greater  than  the  development 
costs.  Therefore,  manufacturing  organizations  in 
the  aerospace  industry  are  a  forcing  function  for 
acquiring  and  implementing  computer-aided 
systems.  This  leads  to  CAD/ CAM  being  a  driv¬ 
ing  initiative  followed  closely  by  group  technology 
and  flexible  machining  systems. 

The  term  CAD/ CAM  has  different  meaning  to  dif¬ 
ferent  enterprises.  Here  it  means  integrated 
computer-aided  design  and  manufacture  in  the 
broadest  sense.  Many  users  have  settled  for  a 
"stand-alone"  CAD  or,  worse,  a  small  segment  of 
CAD  such  as  computer-aided  graphics.  Similarly, 
others  have  seen  CAD  as  numerically  controlled 
(N/C)  tools  or  as  manufacturing  resource  plann¬ 
ing  (MRP).  Fortunately,  this  type  of  thinking  is  be¬ 
ing  extended  to  broader  horizons.  Managers  are 


Figure  57.  Computer-Aided  Design 
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looking  to  the  payback  from  the  synergism  of  an 
integrated  design  and  manufacturing  system  such 
as  that  shown  conceptually  in  Figure  58. 

Real  productivity  improvement  occurs  when  com¬ 
puterized  systems  are  configured  to  use  data  bases 
shared  by  both  engineering  and  manufacturing 
organizations.  There  are  numerous  CAM  applica¬ 
tions  such  as  computer-aided  process  planning 
(CAPP)  and  computer-aided  material  planning  and 
purchasing  (CAMPP). 

The  data  base  management  system  is  a  major  deter¬ 
minant  in  the  success  of  a  computer  integrated 
manufacturing  system.  Data  bases  are  powerful  sets 
of  software  programs  that  control  file  structure 
with  a  practical  balance  of  integrity,  security, 
resource  costs,  and  ease  of  understanding.  Though 
only  becoming  a  practical  reality  in  the  late  1970s, 
software  programs,  software  files,  and  CAD/CAM 
inputs  are  no  longer  separable;  they  must  function 
together  in  a  smooth-running,  integrated,  total 
system.  These  three  integrate  all  of  the  manufac¬ 
turing  related  functions  into  one  monolithic  com¬ 


puter  system  (Computer  Integrated  Manufactur¬ 
ing).  This  goes  well  beyond  traditional  CAD/CAM 
concepts  and  extends  the  limits  of  computer 

systems. 

CAD  Linkage  With  Computer-Aided  Test 

Comprehensive  test  activity  is  fundamental  to  an 
effective  design  and  manufacturing  process.  In  the 
product  cycle  from  the  evaluation  of  initial  design 
concepts  to  the  physical  verification  of  a  manufac¬ 
tured  part,  some  method  of  measurement  is 
necessary.  The  evolution  of  computer  technology 
in  general  and  CAD/ CAM  in  particular  provide 
an  enhanced  capability  to  plan  and  conduct  an  in¬ 
tegrated  test  program. 

CAD  enhances  the  early  design  phase  by  the  use 
of  test  simulations.  This  capability  is  expanded  dur¬ 
ing  the  system  development  phase  through  hard¬ 
ware  in-the-loop  simulation  to  verify  earlier 
parametric  analysis  and  correlation  with  other  test 
data.  In  addition,  engineering,  acceptance,  and 
qualification  testing  are  greatly  facilitated  by  com¬ 
puter  automation.  With  the  increasing  complexi- 


Figure  58.  Integrated  CAD/CAM  System 
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ty  of  equipments,  especially  electronics,  it  is  near¬ 
ly  impossible  to  evaluate  all  test  points  in  a  timely 
fashion  using  manual  methods.  Computer-directed 
tests  conduct  these  activities  in  minutes  and  pro¬ 
vide  hard  copy  printout  without  need  for  an  in¬ 
dividual  to  read  meters  and  transcribe  the  data. 
Computer-aided  technology  assists  in  evaluating 
the  interfaces  between  hardware  and  software  with 
system  "end-to-end"  testing. 

CAD  Linkage  With  Computer-Aided 
Cost  Analysis 

For  as  long  as  computers  have  existed  they  have 
been  used  for  cost  accounting.  Use  was  associated 
with  various  cost-estimating  techniques  and  models 
or  with  the  classic  "after-the-fact"  accounting. 
Computers  were  also  applied  to  the  automated  for¬ 
matting  and  manipulation  of  cost  information  to 
generate  various  reports,  documents,  charts,  and 


tables.  The  capability  expanded  to  document  what 
is  happening  by  tracking  costs  through  systems  like 
C/SCSC  (cost /schedule  control  system  criteria. 
Figure  59).  Though  the  ability  to  track  cost  has  im¬ 
proved  to  "near  real  time,"  cost  prediction  as  a 
design  tool  lags. 

The  real  payoff  in  computer-aided  cost  occurs  when 
life-cycle  cost  and  design  to  cost  estimations  are 
linked  through  real  time  algorithms  to  CAD.  This 
enables  cost  to  be  accurately  reflected  as  a  design 
criteria  with  cost  implications  of  a  given  design  por¬ 
trayed  in  "real  time"  to  the  designer. 

CAD  Linkage  to  Computer-Aided  Logistics 

Since  operation  and  support  of  a  defense  system 
are  such  a  large  part  of  the  life-cycle  cost,  the  ap¬ 
plication  of  computers  to  this  functional  area  can 
be  very  productive  as  it  has  been  in  CAD/ CAM. 


Figure  60.  Design  Workplace  of  the  ’50s 
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Like  the  manufacturing  function,  the  power  of  the 
computer  has  been  first  applied  to  tedious  or 
repetitive  tasks. 

In  this  case,  applications  were  first  found  in  Logistic 
Support  Analysis  (LSA),  spares  management,  and 
documentation  generation.  The  applications  fell  in¬ 
to  two  categories.  These  were  modeling  (like 
simulated  logistic  alterations,  estimated  life-cycle 
costs,  predictability  level  of  repair  requirement)  and 
accounting  (like  invoices,  utilization  trees,  and 
checking  status  against  plans).  The  CAD  was  ap¬ 
plied  as  the  product  definition  base  for  some 
computer-aided  logistic  tasks.  This  succeeded  in 
creating  "islands  of  automation"  rather  than  an  in¬ 
tegrated  net. 

A  Focus  for  Computer-Aided 
Technical  Management 

DOD  has  taken  the  lead  in  facilitating  development 
of  an  integrated  net  for  including  logistic  considera¬ 
tions  (Reference  u).  Specific  areas  of  concentration 


included  data  exchange  standards,  system 
demonstrations,  and  establishing  architecture, 
resources  and  responsibilities  for  system  develop¬ 
ment.  This  initiative  will  provide  significant 
benefits: 

*  Early  application  in  the  development  cycle 
which  permits  interaction  and  reaction  to 
logistic  support  requirements  thus  creating 
more  supportable  systems 

*  Application  of  automation  to  logistic  prod¬ 
ucts  thereby  generating  lower  cost  but 
greater  accuracy 

*  Application  of  automated  communication 
which  generates  less  paper  but  provides 
quicker  updates. 

The  New  Generation  of  Designers 

The  implementation  of  computer  aids  in  the  func¬ 
tional  areas  and  in  the  broader  scheme  of  an  in¬ 
tegrated  system  requires  users  of  the  new  CAD 


Figure  61.  Automating  the  Generation  of  the  Product  Definition  Data  Base 
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tools.  There  is  an  ever-increasing  number  of  entry- 
level  designers  adept  with  those  tools;  but,  interest 
in  this  new  technology  is  not  easily  aroused  in  the 
experienced  staff  who  grew  up  in  a  different  work 
place  (Figure  60). 

Therefore,  design  activities  are  faced  with  a  serious 
issue — go  with  the  current  age  of  designers  who  can 
use  the  tools  but  don't  have  the  experience  or  teach 
the  experienced  designers  how  to  use  the  tools. 
Either  extreme  or  a  mix  implies  turmoil  in  the 
design  function  and  a  real  management  opportuni¬ 
ty.  The  issue  has  been  addressed  by  some  opera¬ 
tions  but,  as  Figure  61  shows,  there  is  a  long  way 
to  go. 

Management  could  select  either  of  the  above 
described  extremes,  but  the  general  approach  is  a 
mix  (Reference  v).  The  mixes  have  included  CAD 
technology  transfer  to  design  experience  and/or  the 
reverse,  and  then  elimination  of  non-productive 
participants.  Various  incentives  have  been  used  to 
stimulate  the  procedure  including: 

*  The  threat  of  elimination  through  the 
above  process 

*  Pay  supplements  for  experienced  designers 
who  demonstrate  CAD  proficiency  be¬ 
fore  a  certain  agreed  date 

*  Released  time  to  attend  CAD  education 
courses  (using  company  equipment  or 
compatible  equipment  off  site) 

*  Tuition  support  for  relevant  courses 

*  Combinations  of  the  above. 

Obviously,  if  the  elimination  of  non-productive 
participants  appears  to  threaten  the  work  force 
generally,  a  new  set  of  "people  management" 
problems  emerges. 

Implementation  of  CAD  will  continue  because  pro¬ 
ductivity  of  the  process  has  been  accepted 
(Reference  t).  However,  through  the  mid  1980s,  the 
general  economy  had  not  experienced  the  desired 
productivity  improvement,  and  in  DOD  there  was 
not  a  reduction  in  development  time  which  would 
be  one  indicator  of  improved  productivity  for  DOD 
products.  Therefore,  contemporary  research  ad¬ 
dressed  the  characteristics  of  the  good  designer 
(Reference  u).  When  the  tools  were  T-squares,  pen¬ 
cils,  paper,  and  slide  rules  and  the  designer  followed 


the  product  into  the  shop  to  get  it  built,  there 
developed  a  relationship  and  "feel"  for  the  result. 
Did  that  mean  anything?  If  so,  how  can  we  get  it 
back?  Or  should  we? 

As  a  counterbalance  to  that  concern,  we  know  that 
the  designer  using  CAD  tools  can  spend  more  time 
at  the  station  thinking  about  problems,  evaluating 
more  alternatives,  and  integrating  more  details;  it 
is  a  matter  of  comfort  and  release  from  repetitive 
detail.  Therefore,  the  initial  impact  of  CAD  may 
have  been  (be)  improvement  of  the  quality  of 
designs  with  long-term  rewards  to  be  reaped  in  the 
life  cycle  of  the  product.  Given  release  from  the 
"garbage  in,  garbage  out"  syndrome  and  conscious 
addition  of  training  programs  to  maintain  product 
"feel,"  quality  of  the  design  process  should  im¬ 
prove.  Those  are  big  "givens"  that  require  eternal 
vigilance. 

Design  Process  Management  Opportunities 

Both  government  and  industry  program  managers 
are  faced  with  source  selection  for  product  designs 
and  the  architecture  of  product  definition  systems. 
The  following  expands  some  topics  introduced 
earlier  for  consideration  in  the  selection  process. 

The  Design  Tools 

Computer  technology  will  continue  to  offer  pro¬ 
ductivity  and  design  quality  enhancements  for  the 
foreseeable  future.  It  will  continue  to  be  important 
to  determine  if  potential  sources  have  optimized 
design  tools  for  the  project  at  hand.  Return  on  in¬ 
vestment  will  continue  to  drive  this  optimization 
process  and,  therefore,  CAD  applications  will  re¬ 
main  uneven  particularly  in  the  subcontractor  and 
supplier  base.  This  does  not  suggest  that  all  DOD 
industry  must  have  the  same  design  tools  but  rather 
that  the  best  source  will  have  the  right  system  for 
the  specific  task.  Key  considerations  (beyond  pro¬ 
ductivity  in  the  hands  of  the  designer)  include: 

*  Compatibility  with  data  input,  output,  and 
retrieval 

*  Capability  to  communicate  with  interfacing 
systems  in  a  timely  manner 

*  Growth  potential  to  remain  current  with  the 
dynamic  state  of  the  art. 
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The  Data  Inputs 

Computers  applied  to  separate  technical  functional 
areas  can  overload  the  integrator  with  data 
(designers  can  become  lost  in  the  interface  matrix 
of  the  system  because  of  the  magnitude  of  the  data 
to  be  integrated  in  a  manner  represented  in  Figure 
62).  This  limits  advances  in  effective  designs  and 
productive  design  processes,  In  other  words,  the 
architectural  application  of  the  computer  has  a 
great  deal  to  do  with  productivity  of  the  design 
process  and  quality  of  system  design. 

Therefore,  DOD  will  apply  ever-increasing  pressure 
to  develop  computer  aids  that  integrate  in  near  real 
time  consideration  of  all  the  special  engineering  re¬ 
quirements  {commonly  called  "ilities")  associated 
with  the  product  life-cycle.  The  evolution  of 
CAD/CAM  (or  more  properly  CAM/CAD)  was 
hastened  as  industry  recognized  the  valuable 
linkage  and,  for  the  most  part,  had  the  process 
under  internal  control.  It  is  not  so  simple  to  con¬ 
ceive  or  portray  incentives  for  industry  to  incor¬ 
porate  rt.al  time  integration  of  the  “ilities"  which 
first  requires  DOD  definition  of  the  requirements. 
Since  the  potential  for  savings  through  life-cycle 
design  is  so  great,  the  management  response  should 
be: 

*  Provide  "design  to"  life-cycle  requirements 

*  Select  sources  that  recognize  the  life-cycle 
design  requirement  and  publicize  benefits  of 
life-cycle  design 

*  As  the  concept  matures,  apply  productive 
cost  evaluation  factors  to  recognize  sources 
(for  life-cycle  design)  that  will  produce  more 
predictable  (higher  quality)  designs. 

The  Designers 

Turmoil  in  the  design  room  is  really  only  beginn¬ 
ing.  The  issues  of  molding  experience  with  new 
tools  and  integrating  masses  of  functional  input 
data  are  only  the  tip  of  the  iceberg.  As  time  passes, 
the  "old"  experience  will  pass  and  the  work  force 
will  look  more  homogenous — and  more  powerful. 
Who  will  control  the  actions  of  this  central  design 
figure  and  how?  Maybe  more  important,  can  the 
employment  demands  of  this  powerful  figure  be 
met?  There  are  several  management  opportunities 
in  DOD  design  source  selection  from  a  "people 
management"  viewpoint: 


*  Evaluate  (at  least  relative  to  other  sources) 
how  well  new  design  process  technology  has 
been  internalized.  How  are  life-cycle  inputs 
entered  into  the  design  activity?  How  is  con¬ 
sideration  of  inputs  assured? 

Determine  if  the  design  process  is  predictable 
from  a  people  point-of-view.  Is  the  process 
mature  or  well  defined  so  that  people  will 
harmonize  and  exchange  data  as  necessary? 
Verify  that  estimates  of  design  performance 
are  based  on  demonstrated  results  of  an 
existing  system  or  determine  the  validity 
of  estimates  based  on  an  unproven 
process. 

*  Underlying  both  of  the  above  analyses 
should  be  a  review  of  specific  personnel 
management  techniques  to  determine  if 
proper  training  and  experience  will  sup¬ 
port  the  design  effort  and  whether 
employee  attitude  will  support  the  pro¬ 
ductive  requirements. 

But,  the  most  effective  management  action  may  be 
putting  the  "old"  experienced  designers  to  work 
with  the  programmers  to  ensure  the  capture  of  hard 
relationships,  ensure  flexibility  in  soft  relationships, 
and  provide  eternal  vigilance  over  the  data  base 
to  protect  creativity  and  innovation.  Programs  to 
test  "ideas"  are  necessary  to  assure  that  new  crea¬ 
tions  are  possible  (e.g.,  not  locked  out). 

Product  Definition  Action 

Obviously,  the  search  is  for  a  design  source  that 
has  the  tools  and  talent  for  the  job  at  the  right  price. 
The  buyer  must  evaluate  the  tools  in  terms  of  pro¬ 
ductive  capacity  to  do  the  job,  ability  to  generate 
alternatives  and  support  tradeoffs,  and  compatibili¬ 
ty  of  data  output  with  system  requirements.  The 
designers  must  be  adept  at  using  the  tools  and  ex¬ 
perienced  in  the  system  design  process.  For  the 
foreseeable  future,  design  rooms  will  exhibit  con¬ 
siderable  tuimoil  in  bringing  new  tools  and  talent 
on-line.  Source  selection  should  be  based  on 
assurance  that  such  turmoil  is  under  control. 

The  design  review  is  the  basic  tool  used  by  the 
DOD  manager  to  control  the  design.  However,  as 
is  the  case  with  many  program  review  points,  if 
a  problem  is  first  identified  at  a  design  review  then 
management  communication  has  been  lacking.  The 
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Figure  62.  Computer-Aided  Product  Definition 
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design  review  process  offers  a  convenient  frame¬ 
work  to  put  product  definition  in  perspective  within 
the  scope  of  system  engineering/technical  manage¬ 
ment  (see  Appendix  C). 

The  designer  sits  at  the  center  of  a  generative  loop 
like  that  shown  in  Figures  62  and  63.  The  process 
is  then  one  of  iteration  and  integration  until  the 


optimum  solution  appears.  Computer  aids  for  this 
implementation  represent  a  formidable  task,  but 
pieces  are  falling  into  place.  It  is  the  manager's  job 
to  guide  the  architectural  growth  of  an  effective 
product  definition  system.  The  process  of  using 
such  a  system  is  called  computer-aided  technical 
management  (CATM). 


Figure  63.  Computer-Aided  Technical  Management 
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APPENDIX  A 

Definitions  of  Important  Terms 
Designing  for  Reliability  and  Maintainability 
(Reference  g) 


E/S  =  System  effectiveness:  The  measure  of  the  extent  to  which  a  system  may  be  expected  to  achieve 
a  set  of  specific  mission  requirements.  It  is  a  function  of  availability,  dependability  and  capability. 

A  =  Availability:  A  measure  of  the  degree  to  which  an  item  is  in  the  operable  and  committable 
state  at  the  start  of  a  mission  when  the  mission  is  called  for  at  an  unknown  (random)  time.  (See 
Reliability,  Availability  and  Maintainability). 

D  =  Dependability:  A  measure  of  the  degree  to  which  an  item  is  operable  and  capable  of  perform¬ 
ing  its  required  function  at  any  (random)  time  during  a  specified  mission  profile,  given  item  availability 
at  the  start  of  the  mission. 

C  =  Capability:  A  measure  of  the  system  ability  to  achieve  the  mission  objectives,  given  the  system 
condition  during  the  mission. 

RAM  =  Reliability,  Availability  and  Maintainability:  The  RAM  requirements  are  those  imposed 
on  acquisition  systems  to  ensure  they  are  operationally  ready  for  use  when  needed,  will  successfully 
perform  assigned  functions  and  can  be  economically  operated  and  maintained  within  the  scope  of 
logistics  concepts  and  policies.  RAM  programs  are  applicable  to  materiel  systems,  test  measurement 
and  diagnostic  equipment,  training  devices  and  facilities  developed,  produced,  maintained,  procured 
or  modified  for  use  (see  individual  definitions  for  Reliability,  Availability,  and  Maintainability). 

R  =  Reliability:  A  fundamental  characteristic  of  an  item  of  material  expressed  as  the  probability 
that  it  will  perform  its  intended  function  for  a  specified  period  of  time  under  stated  conditions  (see 
Reliability,  Availability  and  Maintainability). 

M  =  Maintainability:  The  ability  of  an  item  to  be  retained  in  or  restored  to  specified  condition 
when  maintenance  is  performed  by  personnel  having  specified  skill  levels,  using  prescribed  procedures 
and  resources,  at  each  prescribed  level  of  maintenance  and  repair  (see  Reliability,  Availability  and 
Maintainability). 


APPENDIX  B 

A  Discussion  of  Availability  Factors 


To  support  the  statement  that  over  long  operating  periods,  availability  can  be  expressed  (essential¬ 
ly)  as  a  relationship  between  uptime  (reliability)  and  downtime  (maintainability),  three  types  of 
availability  (inherent  availability:  AI,  achieved  availability:  AA,  and  operational  availability:  AO, 
will  be  discussed. 

Inherent  availability  takes  into  account  only  items  of  system  design.  It  is  availability  which  assumes 
an  ideal  support  environment  and  includes  only  active  corrective  maintenance  time  in  calculation 
of  downtime.  It  excludes  preventive  maintenance  time  and  servicing  time  as  well  as  supply,  ad¬ 
ministrative  and  personnel  delays.  It  is  expressed  in  terms  of  its  designed  mean  time  between  failures 
(MTBF)  and  its  designed  mean  time  to  repair  (or  active  repair  time)  (MTTR)  given  that  it  has  failed: 

AI  -  MTBF/(MTBF  plus  MTTR) 

Achieved  availability  is  calculated  when  preventive  maintenance  is  included  in  the  relationship.  An 
ideal  (no  delay)  support  system  is  still  assumed: 

AA  -  MTBN/(MTBM  plus  MADT) 

MTBM  —  mean  time  between  maintenance  both  corrective  and  preventative 

MADT  ™  mean  active  downtime  which  includes  the  active  elements  of  preventive 
and  corrective  maintenance 

Operational  availability  includes  all  of  the  sources  of  non-operable  time,  active  and  inactive,  in¬ 
cluding  software  downtime,  supply  and  administrative  delay  times,  corrective  and  preventive  main¬ 
tenance,  personnel /maintenance  technician  delays  (a  function  of  items  such  as  of  manning  policies, 
work  cycles,  training,  health  factors,  personnel  vulnerability  in  combat,  location  of  duty  areas  and 
living  quarters). 

AO  -  MTBM/(MTBM  plus  MDT) 

MDT  —  actual  mean  downtime  and  includes  MADT  plus  administrative  and 
logistic  delay  times 

Note:  To  convert  this  relationship  to  cover  total  calendar  time,  add  standby  time  (e.g.,  free  time 
and  storage  time)  to  the  numerator  and  denominator. 

Estimating  these  availabilities,  except  in  very  simple  cases,  requires  construction  of  a  mathematical 
model  which  accounts  for  the  interrelation  of  many  factors  across  the  system.  The  reader  should 
appreciate  that  reliability  is  a  major  driver  in  the  numerator  of  these  relationships  and  an  influence 
on  the  denominator  as  well.  Maintainability  is  a  major  factor  in  MDT,  MADT,  and  MTTR  and, 
therefore,  has  significant  influence  in  the  denominator.  This  is  the  logic  for  the  statement  that  the 
concept  of  availability  is  useful  in  trade-off  studies  for  balancing  reliability  and  maintainability 
requirements. 


APPENDIX  C 


Balancing  on 


Technical  management  as 
discussed  herein  is  the  logical 
and  systematic  conduct  (in¬ 
cludes  planning,  organizing, 
directing,  and  controlling)  of 
the  engineering  effort  required  to 
transform  a  military  requirement  into 
an  effective  operational  system. 

The  manager  conducts  technical 
activities  aimed  at  maximizing  cost 
effectiveness  (Figure  1),  which  is  gen¬ 
erally  accepted  as  the  peacetime 
measure  of  a  program.  This  effort  re¬ 
quires  the  technical  manager  to  do  a 
balancing  act  between  cost,  schedule, 
and  effectiveness.  What  is  the  proper 
phasing  of  major  activities  in  the  bal¬ 
ancing  act  which  will  result  in  a  cost- 
effective  program? 

The  most  significant  system  acqui¬ 
sition  elements  are  shown  in  Figure  2. 
The  manager  must  integrate  these 
into  the  technical  effort  of  a  system 
acquisition  from  initiation  to  dis¬ 
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mative  approach  to  the  broad-based 
activities  in  general  time  frames  and 
should  not  be  strictly  interpreted. 


Overview 


posal.  They  are  N. 
shown  radiating  from 
basic  functional  areas 
—systems  (hardware  and 
software),  logistics,  test 
and  evaluation,  production — 
with  engineering  at  the  core.  The 
figure  illustrates  the  broad  base  and 
complexity  of  technical  management. 
Operation  within  the  specific  disci¬ 
plines  is  even  more  difficult.  There¬ 
fore,  the  faculty  of  the  Defense  Sys¬ 
tems  Management  College  Technical 
Management  Department  developed 
the  Acquisition  Life  Cycle  Technical 
Activities  Chart  (see  fold-out  at  the 
end  of  this  article)  as  a  management 
tool.  The  chart  represents  a  nor¬ 


The  designation  of  technical  man¬ 
agement  functional  engineering  areas 
as  systems,  logistics,  test  and  evalua¬ 
tion,  production,  and  cost  sometimes 
parallels  divisions  of  labor  for  appli¬ 
cation  of  specialties  in  the  program 
office.  There  may  be  some  argu- 
V  ment  that  systems  engineering 
^^encompasses  all  the  technical 
functional  areas  and/or 
>ythat  logistics  is  a  broader 
discipline  than 
indicated. 


However,  it  is  not  ^^our  intention 
to  create  or  address  ^s^such  con¬ 
troversy  here,  but  merely  >^0  use 
the  terms  in  formation  of  a 
matrix  that  exposes  more  detailed 
activities. 


to 

_  * 

KWiW 


m 


COST 

EFFECTIVENESS 
_ 1 

SYSTEM 

EFFECTIVENESS 


SYSTEM 

COST 


PROBABILITY  OF 
MISSION  SUCCESS 


READINESS  TO 
CONDUCT  MISSION 


PERFORMANCE  DEPENDABILITY 


For  our  purposes,  we  use  technical 
management  as  the  broad  discipline 
that  encompasses  all  technical  and 
functional  areas. 

The  other  variable  of  the  matrix  is 
program  time.  In  this  discussion,  sys¬ 
tem  acquisition  phases — concept  for¬ 
mulation,  demonstration/validation, 
full-scale  development,  production 
and  deployment — are  convenient  de¬ 
scriptors  of  time  spans  in  which  to 
group  activities.  In  this  way,  techni¬ 
cal  management  can  be  broken  down 
to  detailed  activities  by  functional 
disciplines  and  program  phase.  The 
Acquisition  Life-Cycle  Technical  Ac¬ 
tivities  Chart  provides  a  concise  de¬ 
scription  of  the  activities. 

There  are  important  activities  in 
all  functional  areas  starting  in 
the  earliest  phase  of  the  acqui¬ 
sition  life  cycle  and  continuing 
through  most  of  the  program. 
The  general  thrust  of  technical  man¬ 
agement  goes  like  this: 

— Define  what  it  takes  to  support, 
produce,  and  test  the  system  utilizing 
analyses.  Then  see  if  we  can  afford  it. 
—Influence  the  design  through  pro- 
ducibility  engineering,  logistic  analy¬ 
sis,  testability  design,  and  design  to 
cost.  Develop  specifications  and 
translate  requirements  to  contract 
language. 

— Prepare  to  execute  by  arranging  for 
the  test  facilities,  acquiring  and  set¬ 
ting  up  the  production  line,  designing 
and  acquiring  the  logistic  support. 
—Execute  by  testing,  manufacturing, 
supporting. 

The  chart  is  a  rigorous  endeavor  to 
show  all  the  technical  management 
activities  in  relative  time  phase.  As 
such,  it  provides  the  manager  a  check 
list  of  activities  that  should  be  accom¬ 
plished  and  integrated  in  the  various 
program  phases. 

Delving  into  the  details  of  the  chart 
will  soon  confirm  that  hard  work  by 
management  at  the  beginning  will 
pay  off  later.  Early  technical  deci¬ 
sions  have  a  profound  effect  on  total 
system  cost  and  schedule,  but  there 
are  continuing  requirements  for  im¬ 
portant  technical  activities  and  inte¬ 
gration.  The  chart  provides  a  guide¬ 
line  for  accomplishing  the  technical 
management  task.  An  explanation  of 
functional  discipline  terminology  is 
included  at  the  end  of  this  article. 


Acquisition  Life-Cycle 
Technical  Activities 

General 

Technical  activities  are  the  genesis 
of  a  weapon  system  and  continue 
through  its  life.  The  matrix  in  Figure  3 
generally  relates  time  to  technical  ac¬ 
tivities.  The  third  dimension  in  man¬ 
aging  this  kind  of  effort  is  integration, 
that  is,  feedback  and  problem  resolu¬ 
tion  between  activities,  and  planning 
for  the  future.  Any  one  management 
output  must  be  based  upon  data  and 
feedback  developed  during  the  gener¬ 
ation  of  others.  In  other  words,  they 
must  not  only  be  consistent,  but  must 
also  utilize  the  integrative  power  of 
functional  consultation.  The  whole  is 
greater  than  the  sum  of  the  parts. 

There  are  some  general  integration 
flows  that  run  through  the  chart: 

—Specifications  flow  from  systems 
(A)  to  development  (B)  to  product 
(C),  process  (D),  and  material  (E). 

— These  are  reflected  in  the  contract 
cycle:  specification,  statement  of 
work  (SOW),  request  for  proposal 
(RFP)  converted  through  the  selection 
process  to  contractor  effort. 
—Product  baseline  is  developed. 
—The  review  process,  i.e.,  system  re¬ 
quirements  review  (SRR),  system  de¬ 
sign  review  (SDR),  preliminary  de¬ 
sign  review  (PDR),  and  critical  design 
review  (CDR),  focuses  integra¬ 
tion/definition  of  the  product. 

— Test  results  provide  feedback  for 
analysis  of  performance  progress. 
—The  overall  technical  management 
holds  the  activity  together  in  the  bal¬ 
ancing  act  between  cost,  schedule, 
and  effectiveness. 

The  following  brief  narrative  ad¬ 
dresses  technical  management  activi¬ 
ties  and  integration.  We  have  tried  to 
avoid  getting  lost  depicting  a  maze  of 
feedback  loops,  or  attempting  to  ar¬ 
ticulate  rigorous  discussion  of  policy, 
rules,  or  differences  between  types  of 
programs. 

■  Mr.  Arnold  is  a  Professor  of  En¬ 
gineering  Management  in  the  Techni¬ 
cal  Management  Department,  School 
of  Systems  Acquisition  Education. 
Mr.  Stepler  was  a  Professor  of  Sys¬ 
tems  Acquisition  Management  in  that 
department  before  recently  trans¬ 
ferring  to  Headquarters,  Lexington 
Bluegrass  Army  Depot,  in  Kentucky. 


Concept  Exploration 

Document  outputs  of  the  concept 
exploration  phase  include: 

—System  specification  (A) 
—Hardware 
—Software 

—System  requirement  review  (SRR) 
—Hardware 
— Software 

—System  engineering  management 
plan  (SEMP) 

—Integrated  logistics  support  master 
plan  (ILSMP) 

—Test  and  evaluation  management 
plan  (TEMP) 

—Acquisition/manufacturing  strate¬ 

gy 

—"Design  to"  goals 
—Total  quantity 
—Production  rate 

The  key  effort  during  concept  ex¬ 
ploration  is  generation  of  the  system 
(A)  specification  and  establishment  of 
the  functional  baseline.  Supporting 
this  activity  and  projecting  the  system 
engineering  effort  are  the  system  re¬ 
quirements  review  and  the  system  en¬ 
gineering  master  plan.  These  activi¬ 
ties  must  require  and  consider  realis¬ 
tic  inputs  from  technical  functions: 

(1)  The  dynamic  policy  and  tech¬ 
nology  of  software; 

(2)  Logistics  support  implications 
(cost,  schedule,  performance)  and  re¬ 
quirements; 

(3)  Feasibility  of  testing  and 
feasibility  testing;  and 

(4)  Producibility. 

Demonstration/Validation 

(DEM/VAL) 

Document  outputs  of  the  DEM/ 
VAL  phase  include: 

—Development  specification  (B) 
—Hardware 
—Software 

—System  design  review  (SDR) 
—Hardware 
—Software 

—Integrated  logistics  support  plan 
(ILSP) 

—Logistic  support  analysis  (see  also 
concept  exploration) 

—Prototype  test  results 

—Test  and  evaluation  master  plan 

update 

—Resolution  of  production  risk(s) 
—Preliminary  manufacturing  plan 

As  the  development  specification  is 
generated  and  the  allocated  baseline 
established,  the  functional  specialists 


continue  to  expand  knowledge  of  the 
system,  generate  input  for  system  de¬ 
sign,  and  define  the  remaining  pro¬ 
gram  tasks. 

Software.  A  system  software  syn¬ 
thesis  is  conducted  and  system  re¬ 
quirements  established.  The  basis  for 
monitoring  quality  is  established  and 
the  effort  commences.  An  independ¬ 
ent  verification  and  validation  ap¬ 
proach  is  selected  (or  not)  and  the 
procedure  starts. 

Logistics.  The  logistics  support 
system  concept  is  developed.  Logis¬ 
tics  support  analysis  is  conducted/ 
continued  to  determine  (current) 
alternatives  and  system  design 
drivers. 

Test  and  Evaluation.  Prototype 
testing  is  conducted  and  reported. 
The  test  and  evaluation  master  plan  is 
updated  for  the  current  technology 
and  system  design.  Better  techniques 
may  be  available  to  accomplish  T&E; 
the  design  may  change  and  require  a 
different  T&E  approach. 

Production.  Producibility  paper 
studies  are  turned  into  technical  mod¬ 
ification/manufacturing  technology 
programs,  preliminary  production 
engineering,  and  preliminary  manu¬ 
facturing  plans.  Preplanned  product 
improvement  feedback  is  provided. 

Full-Scale  Development  (FSD) 

Document  outputs  of  the  FSD 
phase  include: 

— Product  specification  (C) 

—Hardware 

—Software 

—Process  specification  (D) 

— Material  specification  (E) 

— Logistics  support  definition 
— Engineering  development  test  re¬ 
port^) 

— T&E  master  plan  update 
— Manufacturing  plan 
— Production  readiness  review  report 
—Design  documentation 

—Rate  production 

—Complete  support 
—Quality  assurance  plan 

As  the  final  details  of  the  system 
design  are  committed  to  specification: 

—Software  is  designed,  coded, 
tested,  and  product  specification 
finalized; 

— Logistics  support  is  defined  and  ac¬ 
quisition  started; 

— Development  test  results  are  re¬ 


ported  and  the  T&E  master  plan  up¬ 
dated  for  current  technology  and  de¬ 
sign  change; 

—Development  test  and  evaluation 
flows  into  initial  operational  test  and 
evaluation;  and 

—Production  engineering  is  a  driver 
for  the  final  manufacturing  plan,  but 
earlier  work  should  make  this  an  op¬ 
timization  activity— low-rate  initial 
production  may  be  included— the 
evaluation/quality  assurance  plans 
are  finalized— all  in  support  of  a  dem¬ 
onstration  of  readiness  for  produc¬ 
tion. 

Production  and  Deployment 

Document  outputs  during  Produc¬ 
tion  and  Deployment  include: 

— Functional  quality  review  report 
—Production  configuration  audit  re¬ 
port 

—Logistic  documentation  delivera¬ 
bles 

—T&E  reports  for  final  operational 
and  product  assurance  testing 
— Product  disclosure  package 
— Contractor(s)  surveillance  reports 
— Implementation  of  manufacturing 
strategy 

— GFP  support 

—Value  engineering 

—Second  source 

— Breakout 

Detailed  reviews  are  conducted  to 
be  sure  that  the  design  disclosure 
package  is  suitable  for  its  intended 
use — system  production  to  meet  user 
requirements.  Logistic  delivera¬ 
bles — manuals,  spares,  fielding  sup¬ 
port  training,  maintenance— are  ac¬ 
quired.  The  manufacturing  plan  is  ex¬ 
ecuted,  including  appropriate  value 
engineering  and  tactical  activities 
such  as  establishing  a  second 
source(s),  component  breakout,  and 
preplanned  product  improvement 
(P3I).  The  total  effort  eventually  be¬ 
comes  post-production  support 
(hardware  and  software)  wherein 
most  if  not  all  of  the  system  effort  is 
conducted  within  the  using  military 
service. 

Summary 

Criticism  of  weapon  system  acqui¬ 
sition  costs  has  focused  a  great  deal  of 
attention  on  the  procurement  proc¬ 
ess.  Initiatives  to  improve  the  process 
are  being  implemented.  The  chart  is 
intended  to  advance  the  thought  that 
the  best  way  to  improve  the  acquisi¬ 


tion  process  is  to  do  it  the  way  it  is 
supposed  to  be  done.  Most  problems 
can  be  traced  to  ignoring  essential  ac¬ 
tivities  (such  as  life-cycle  analysis, 
logistic  support  analysis,  producibil¬ 
ity  engineering)  or  taking  "short  cuts" 
that  require  extensive  effort  to  "back 
fill"  later.  Timely  technical  activities 
should  develop  appropriate  specifica¬ 
tions,  develop  producible  designs, 
provide  meaningful  evaluation,  en¬ 
courage  productive  facilities,  provide 
effective  support,  budget  and  con¬ 
tract  for  effective  production,  and 
maintain  system  readiness. 

This  is  the  first  publication  of  the 
chart.  It  is  intended  for  use  in  pro¬ 
gram  management  offices  and  by 
others  concerned  with  understanding 
the  technical  aspects  of  the  system  ac¬ 
quisition  process.  The  content  is 
oriented  toward  a  large  system  pro¬ 
curement,  but  the  flow  of  activity 
should  be  generally  applicable  to 
weapon  systems.  Comment  is  encour¬ 
aged  and  should  be  directed  to  the 
authors  at  the  publication  address. 
Reproductions  of  the  chart  are  avail¬ 
able  by  writing  Technical  Manage¬ 
ment  Chart,  Defense  Systems  Man¬ 
agement  College,  ATTN:  SE-T,  Fort 
Belvoir,  Va.  22060. 

FUNCTIONAL  TERMINOLOGY 
AND  USAGE 

Production  Definition 

Requirements  scrub.  Review  of 
user/govemment  comments  received 
in  response  to  announcement  of  an 
operational  requirement.  The  scrub  is 
used  to  validate  and  prioritize  sug¬ 
gested/requested  system  functions/ 
capabilities  before  release  to  industry. 

System  requirements  review  (SRR). 
To  ensure  that  system  requirements 
have  been  completely  and  properly 
identified  and  that  there  is  a  mutual 
understanding  between  the  govern¬ 
ment  and  contractor. 

Type  A,  B,  C,  D,  E  specifications. 
See  functional,  allocated,  and  prod¬ 
uct  baselines. 

Baselines 

Functional  baseline.  The  technical 
portion  of  the  program  requirements 
(type  A  spec);  provides  the  basis  for 
contracting  and  controlling  the  sys¬ 
tem  design. 

Allocated  baseline.  Development 
specification  (type  B  spec)  defines  the 
performance  requirements  for  each 


configuration  item  of  the  system. 

Product  baseline  (type  C  spec). 
Established  by  the  detail  design 
documentation  for  each  configura¬ 
tion  item.  Normally  includes: 

—Process  baseline  (type  D  spec); 
and 

— Material  baseline  (type  E  spec). 

Request  for  proposal  (RFP),  state¬ 
ment  of  work  (SOW),  contract  data 
requirements  list  (CDRL).  The  docu¬ 


ments  used  in 
letting  contracts  for  each  phase 
of  work.  The  RFP  sets  forth 
the  needs;  the  SOW  is  the  for¬ 
mal  statement  of  these  needs 
as  requirements  for  contractual 
effort;  and  the  CDRL  defines 
the  data  deliverables. 


System  Engineering 
(Hardware) 


System  engineering  management 
plan  (SEMP).  Includes  plans  for  veri 
fkation,  risk  alleviation,  analyses, 
and  simulation  of  the  system  re¬ 
quirements. 

System  requirement  documents 
(SRD).  Refine  the  mission  re 
quirements  through  analysis  that 
evolves  a  system  design  concept  and 
interfaces. 

System  design  review  (SDR).  Re¬ 
views  the  conceptual  design  of  the 
system  and  establishes  its  capability 
to  satisfy  requirements. 

Preliminary  design  review  (PDR). 
Follows  preliminary  design  efforts 
and  results  in  approval  to  begin  de¬ 
tailed  design. 

Critical  design  review  (CDR).  Re¬ 
views  the  completeness  of  the  design 
and  interfaces. 

Functional  configuration  audit 
(FCA).  Verifies  that  the  actual  item 
that  represents  the  production  config 
uration  complies  with  the  develop¬ 
ment  specification. 

Formal  qualification  review  (FQR). 
A  systems-level  configuration  audit 
conducted  after  system  testing  is  com¬ 
pleted  (to  ensure  performance  re¬ 
quirements  of  the  system  specifics 
tion  have  been  met). 

Physical  configuration  audit 
(PCA).  A  means  of  establishing  the 
product  baseline  as  reflected  in  an 
early  production  configuration  item. 


Systems  Engineering  (Software) 


Policy/technology  assessment. 
DOD  Directives  5000.29  and  5000.31 


reflect  current  DOD  policies.  Addi¬ 
tional  information  is  in  AR  1001-1 
(Army),  Mil-S-1679  (Navy),  and  AFR 
800-14  Vols.  I  and  II  (USAF). 

Computer  program  development 
plan  (CPDP).  A  management  plan 
usually  generated  by  the  developer 
that  presents  the  software  effort. 

Computer  resources  integrated 
support  plan  (CRISP)  (USAF),  com¬ 
puter  resources  management  plan 


(CRMP)  (Army),  computer  resources 
life-cycle  management  plan 
( CRLCMP )  (Navy).  Life-cycle  soft¬ 
ware  management  plans  developed 
by  program  managers  and  their  man¬ 
agement  team. 

Independent  verification  and 
validation  (IV&V).  An  independent 
review  of  the  software  product  for 
functional  effectiveness  and  technical 
sufficiency. 


Quality  assurance  (QA).  The  proc¬ 
ess  of  assuring  that  a  software 
product  is  produced  that  performs 
properly,  has  minimum  support 
requirements,  and  facilitates  main¬ 
tenance  as  specified. 


Software  system  synthesis.  The 
analysis  of  user/buyer  requirements 
to  produce  functional  requirements 
for  software  at  the  A-specification 
level. 

Software  requirements  generation. 
The  decomposition  of  the  A-specifi¬ 
cation  requirements  into  functional 
requirements  that  are  allocated  to 
software. 

Software  design.  The  designing  of 
the  software  systems  to  meet  the 
functional  requirements  allocated  in 
the  B-specification. 

Software  programming.  The 
coding  of  the  software  in  accordance 
with  the  software  design. 

Software  testing.  The  testing  of  the 
software  to  the  functional  require¬ 
ments  presented  in  the  B-specifica- 
tion. 

System  engineering  (hardware)  ac¬ 
tivities  for  SRR,  SDR,  PDR,  CDR, 
FCA/ PCA,  A  Spec,  B  Spec,  C  Spec 
also  apply  to  software. 


Integrated  Logistics  Support  (ILS) 


ILS  strategy  development.  Logistics 
acquisition  strategy  is  developed  set¬ 
ting  forth  objectives,  resources,  man¬ 
agement  assumptions,  extent  of  com¬ 
petition,  proposed  contractual  vehic¬ 
les,  program  structure,  but  with  em¬ 
phasis  on  maintenance  approach,  op¬ 
erational  support  patterns,  con¬ 
straints,  significant  items,  contractor 
role,  GFE,  including  life-cycle  sup¬ 
port,  transition,  warranties,  and 
post-production  support. 

ILS  alternatives/ trade-offs  assess¬ 
ment.  Largely  a  data-gathering  and 
model  exercise.  Data  comes  from 
"lessons  learned"  files,  comparative 
analysis,  technological  opportunities, 


use  studies,  field  visits,  standardiza¬ 
tion  requirements,  functional  and 
military  requirements,  constraints, 
maintenance,  and  operational  ap¬ 
proaches.  Analyses  and  assessments 
are  made  on  the  cost  and  effectiveness 
of  supporting  the  identified  alter¬ 
natives. 

Integrated  logistics  support  man¬ 
agement  plan  (ILSMP).  The  early  lo¬ 
gistics  plan  dealing  with  organiza¬ 
tional  authorities  and  responsibilities 
and  containing  broad  logistics  strate¬ 
gy,  goals/thresholds,  and  mainte- 
n^nre  concepts. 

Integrated  logistics  support  plan 
(ILSP).  The  formal  planning  docu¬ 
ment  for  logistics  support.  It  is  kept 
current  through  the  program  life.  It 
sets  forth  the  plan  for  operational 
support,  provides  a  detailed  ILS  pro¬ 
gram  to  fit  with  the  overall  program, 
provides  decision-making  bodies  with 
necessary  ILS  information  to  make 
sound  decisions  in  system  develop¬ 
ment  and  production,  and  provides 
the  basis  for  ILS  procurement 
packages-specifications  RFPs,  SOWs, 
source-selection  evaluation,  terms 
and  conditions,  CDRLs. 

Logistics  support  analysis  (LSA).  A 
formal  tool  under  MIL-STD-1388 
that  helps  identify  and  trade  off  quali¬ 
tative  and  quantitative  logistics  sup¬ 
port  requirements.  It  is  a  logical,  doc¬ 
umented  basis  from  which  to  influ¬ 
ence  design  and  force  a  degree  of  re¬ 
quirements  integration.  It  also  pro¬ 
vides  a  yardstick  from  which  to  assess 
logistics  objective  achievement. 

Logistics  support  analysis  record 
(LSAR).  The  formal  notation  of 
design  results  in  stylized  format  using 
forms  for  operations  and  mainte¬ 
nance  requirements,  RAM,  task 
analyses,  S  and  TE,  facilities,  skill 
evaluation,  supply  support,  ATE  and 
TPS,  and  transportability.  LSAR  is 
the  basis  for  training,  personnel,  sup¬ 
ply  provisioning  and  allowances  con¬ 
struction,  S  and  TE  acquisition,  fac;li- 
ties  construction  and  preparation, 
and  for  maintenance— preventive  and 
corrective.  Reference  MIL-STD-1388. 

Material  Fielding  and  Training. 
The  action  of  checking  out  equipment 
functions  and  operator  and  mainte¬ 
nance  personnel  training  after  pro¬ 
duction  and  before  turnover  to  users. 

Post  production  support  (PPS). 
The  planning  for  and  provision  of 
logistics  support  to  the  system  after 
the  end  item  production  line  has 


closed  down  (often  a  10-20  year 
period).  Requires  tailored  support  ac¬ 
tivity  usually  documented  in  a  PPS 
ILSP. 

Test  and  Evaluation  (T&E) 

Three  types  of  T&E— development 
test  and  evaluation  (DT&E),  opera¬ 
tional  test  and  evaluation  (OT&E), 
and  production  acceptance  test  and 
evaluation  (PAT&E)  occur  during  the 
acquisition  cycle.  DT&E  is  conducted 
to  assist  the  engineering  design  and 
development  process  and  to  verify  at¬ 
tainment  of  technical  performance 
specifications  and  objectives.  OT&E 
is  conducted  to  estimate  a  system's 
operational  effectiveness  and  suitabil¬ 
ity,  identify  needed  modifications, 
and  provide  information  on  tactics, 
doctrine,  organization,  and  personnel 
requirements.  PAT&E  is  conducted 
on  production  items  to  demonstrate 
that  those  items  meet  the  require¬ 
ments  and  specifications  of  the  pro¬ 
curing  contracts  or  agreements. 
OT&E  is  further  subdivided  into  two 
phases— initial  operational  test  and 
evaluation  (IOT&E)  and  follow-on 
operational  test  and  evaluation 
(FOT&E).  IOT&E  must  be  conducted 
before  the  production  decision  (Mile¬ 
stone  III)  to  provide  a  credible  esti¬ 
mate  of  operational  effectiveness  and 
suitability.  Therefore,  IOT&E  must 
be  conducted  on  a  system  as  close  to  a 
production  configuration  as  possible, 
in  an  operationally  realistic  environ¬ 
ment,  by  typical  user  personnel. 
FOT&E  is  conducted  on  the  deployed 
system  to  determine  if  operational  ef¬ 
fectiveness  and  suitability  is,  in  fact, 
being  attained. 

Test  and  evaluation  master  plan 
(TEMP).  The  test  and  evaluation 
master  plan  is  the  top-level  test  man¬ 
agement  document.  The  TEMP  is  pre¬ 
pared  at  the  PMO  level  and  includes 
inputs  from  all  participating  agencies, 
with  special  emphasis  on  the  test  re¬ 
quirements  of  the  independent  opera¬ 
tional  test  agency.  There  is  a  30-page 
limit  imposed  by  DODD  5000.3; 
however,  the  TEMP  must  include  a 
system  and  mission  description,  T&E 
management  and  schedules,  the 
status  and  plans  for  development, 
operational,  and  production  accep¬ 
tance  testing,  critical  T&E  issues,  and 
test  resource  requirements.  Prior  to 
Milestone  I,  the  TEMP  is  submitted  to 
the  Director  of  Defense  Test  and 
Evaluation  (DDT&E)  for  review  and 


approval.  This  approval  establishes  a 
"contract"  between  the  service  and 
OSD  for  testing  throughout  the  life 
cycle  of  the  system,  since  the  TEMP 
covers  all  phases  of  testing.  Subse¬ 
quent  to  its  initial  issue,  the  TEMP  is 
updated  at  each  major  milestone.  In- 
process  updates  can  also  be  accom¬ 
plished  at  any  time  there  is  a  signifi¬ 
cant  change  to  the  test  program  speci¬ 
fied  in  the  approved  TEMP. 

Test  results/ reports.  The  conduct 
of  testing,  and  the  associated  collec¬ 
tion,  reduction,  and  analysis  of  test 
data,  is  a  continuous  process 
throughout  the  acquisition  life  cycle. 
The  issuance  of  formal  development 
and  operational  test  reports  is  typical¬ 
ly  aligned  with  the  major  milestones 
to  provide  the  essential  risk  reduction 
information  and  to  support  the  pro¬ 
gram  decisions.  The  issuance  of  inde¬ 
pendent  OT&E  reports  by  the  inde¬ 
pendent  operation  test  agency  is  con¬ 
sidered  critical  to  the  support  of  the 
DSARC  decision  process. 

Information  from  testing  is  for¬ 
warded  to  OSD  and  Congress  by 
both  informal  and  formal  means  (in¬ 
cluding  the  dissemination  of  the 
aforementioned  test  reports).  Formal 
T&E  briefings  are  made  to  DDT&E 
and  others  in  the  OSD  staff  approx¬ 
imately  3  weeks  before  each  DSARC 
for  the  system.  Information  on  test 
results  is  transmitted  to  Congress  on  a 
recurring  basis  as  part  of  the  selected 
acquisition  reports  (SARs)  and  con¬ 
gressional  data  sheets  (CDS). 

Production 

Evaluate  production  feasibility. 
Assess  the  likelihood  that  a  system 
design  concept  can  be  produced  using 
existing  manufacturing  technology. 

Assess  production  risks.  Estimate 
probabilities  of  success  or  failure  in 
manufacturing. 

Identify  manufacturing  technology 
needs.  Discriminate  manufacturing 
capabilities  vs.  requirements  to  define 
new  facilities  and  equipment  needs. 

Estimate  manufacturing  cost. 
Develop  estimates  of  the  resources  re¬ 
quired  for  various  systems  alterna¬ 
tives. 

Design  to  goals.  Requirement-  or 
policy-driven  constraints  on  design 
parameters  for  the  system. 

Acquisition/manufacturing  strate¬ 
gy.  The  approach  to  obtaining  the 
total  quantity  of  a  system  at  some 
rate  for  some  cost. 
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Resolve  production  risk.  Demon¬ 
strate  required  advances  beyond  the 
current  capability. 

Complete  manufacturing  technol¬ 
ogy  development.  Manufacturing 
technology  is  developed  through  a 
phased  approach  from  definition  to 
demonstration.  This  represents  the 
final  demonstration  of  the  integrated 
manufacturing  scheme. 

Preliminary  manufacturing  plan.  A 
method  of  employing  the  facilities, 
tooling,  and  personnel  resources  to 
produce  the  design. 

Preliminary  producibility ,  engi¬ 
neering  and  planning  (PEP).  Initial 
application  of  design  and  analysis 
techniques  to  reduce  the  potential 
manufacturing  burden. 

Industrial  base  issues.  Critical  re¬ 
sources,  skills,  and  long-lead  materi¬ 
als  and  processes  required  by  the 
system  design. 

Finalize  manufacturing  plan.  Re¬ 


fine  and  formalize  initial  manufactur¬ 
ing  plan. 

Execute  PEP.  Incorporate  the  pro¬ 
ducibility  analysis  into  the  main¬ 
stream  design  effort. 

QA  plan.  Initiate  a  quality  assur¬ 
ance  plan  to  include  quality  of  design 
and  quality  of  conformance. 

Low  rate  initial  production  (LRIP). 
Low  rate  of  output  used  to  prove 
manufacturing  technology  and  facili¬ 
ties  at  the  beginning  of  production. 

Production  readiness  review 
(PRR).  Formal  examination  of  a  pro¬ 
gram  to  determine  if  the  design  of  the 
product  and  process  are  ready  for  the 
production  phase. 

Contractor  surveillance.  Execution 
of  production  contracts  incorporating 
appropriate  quality  assurance  docu¬ 
mentation  and  observation.  Surveil¬ 
lance  may  be  conducted  by  on-site 
government  representatives,  author¬ 
ized  specialists,  the  program  office,  or 


a  combination. 

Post-production  support  (manufac¬ 
turing).  Arrange  for  purchase  of 
spare  parts  or  a  portion  of  normal 
production  runs. 

Value  engineering  (VE).  A  program 
to  allow  for  the  sharing  of  cost  sav¬ 
ings  derived  from  improvements  in 
the  manufacturing  processes. 

Second  source.  Execution  of  estab¬ 
lished  acquisition  strategy  to  establish 
two  producers  for  the  part  or  system. 

Breakout.  Execution  of  established 


acquisition  strategy  to  convert  some 
parts  or  systems  from  contractor- 
furnished  to  government-furnished. 

GFP  support.  Execution  of  con¬ 
tracts  and  management  of  items  pro¬ 
vided  as  government-furnished  prop¬ 
erty  to  the  contractor. 

Life-cycle  cost  (LCC).  The  net  ex¬ 
penditure  (usually  an  estimate)  for  ac¬ 
quiring  and  using  an  item.H 
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